Sep 02 16:11:54 devstack cinder-volume[76082]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 16:11:54 devstack cinder-volume[76082]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 16:11:54 devstack cinder-volume[76082]: we strongly recommend against using it for new projects. Sep 02 16:11:54 devstack cinder-volume[76082]: If you are already using Eventlet, we recommend migrating to a different Sep 02 16:11:54 devstack cinder-volume[76082]: framework. For more detail see Sep 02 16:11:54 devstack cinder-volume[76082]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 16:11:54 devstack cinder-volume[76082]: import eventlet # noqa Sep 02 16:11:56 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:11:56 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:11:56 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:11:57 devstack cinder-volume[76082]: INFO dbcounter [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Registered counter for database cinder Sep 02 16:11:57 devstack cinder-volume[76082]: DEBUG oslo_db.sqlalchemy.engines [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG dbcounter [-] [76082] Writer thread running {{(pid=76082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.rpc [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.rpc [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG oslo_db.sqlalchemy.engines [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.volume.manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Determined volume DB was empty at startup. Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG cinder.volume.manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76082) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.volume.manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 16:11:58 devstack cinder-volume[76082]: WARNING stevedore.named [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 16:11:58 devstack cinder-volume[76082]: WARNING castellan.key_manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:11:58 devstack cinder-volume[76082]: WARNING cinder.keymgr.conf_key_mgr [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG cinder.volume.drivers.lvm [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76082) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG oslo_concurrency.processutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG oslo_concurrency.processutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=76082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:11:58 devstack cinder-volume[76082]: DEBUG oslo_db.sqlalchemy.engines [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.rpc [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.rpc [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 02 16:11:58 devstack cinder-volume[76082]: WARNING stevedore.named [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 16:11:58 devstack cinder-volume[76082]: WARNING castellan.key_manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:11:58 devstack cinder-volume[76082]: INFO cinder.volume.manager [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_db.sqlalchemy.engines [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:11:59 devstack cinder-volume[76082]: INFO oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Starting 1 workers Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Started child 76241 {{(pid=76082) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Full set of CONF: {{(pid=76082) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] ******************************************************************************** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Configuration options gathered from: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] ================================================================================ {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 16:11:59 devstack cinder-volume[76241]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] allow_availability_zone_fallback = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] allow_compression_on_image_upload = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] allowed_direct_url_schemes = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] api_rate_limit = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] auth_strategy = keystone {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] az_cache_duration = 3600 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_availability_zone = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_host = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_stats_polling_interval = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backup_api_class = cinder.backup.api.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backup_name_template = backup-%s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backup_use_same_host = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backup_use_temp_snapshot = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] chap_password = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] chap_username = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_internal_tenant_project_id = d9b8f93d3cf649549f242bab8e7e7613 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_internal_tenant_user_id = f77e576b54b64ee9a2f948d8ae9996d5 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cloned_volume_same_az = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cluster = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] compression_format = gzip {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] compute_api_class = cinder.compute.nova.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] config_dir = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] config_source = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] control_exchange = openstack {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] debug = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] default_availability_zone = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] default_group_type = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] default_volume_type = lvmdriver-1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] disk_geometry = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_client_cert = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_client_cert_key = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_data_namespace = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_ssl_cert_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_ssl_cert_verify = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] driver_use_ssl = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] enable_force_upload = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] enable_new_services = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] enable_unsupported_driver = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] enforce_multipath_for_image_xfer = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] filter_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_api_insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_api_ssl_compression = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_ca_certificates_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_catalog_info = image:glance:publicURL {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_num_retries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance_request_timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] goodness_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] graceful_shutdown_timeout = 5 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] group_api_class = cinder.group.api.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] host = devstack {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_compress_on_upload = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_conversion_address_space_limit = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_conversion_cpu_limit = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_conversion_disable = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_upload_use_cinder_backend = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_upload_use_internal_tenant = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_volume_cache_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_volume_cache_max_count = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] init_host_max_objects_retrieval = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] instance_format = [instance: %(uuid)s] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iscsi_target_flags = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iscsi_write_cache = on {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iser_helper = tgtadm {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iser_ip_address = 192.168.122.38 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iser_port = 3260 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_color = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_config_append = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_dir = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_options = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_rotate_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_rotate_interval_type = days {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] log_rotation_type = none {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] max_age = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] max_logfile_count = 30 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] max_logfile_size_mb = 200 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] max_over_subscription_ratio = 20.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] message_reap_interval = 86400 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] message_ttl = 2592000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] monkey_patch = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] monkey_patch_modules = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] my_ip = 192.168.122.38 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] no_snapshot_gb_quota = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] num_iser_scan_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] num_shell_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] num_volume_device_scan_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] nvmeof_conn_info_version = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] nvmet_ns_id = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] nvmet_port_id = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_max_limit = 1000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_ext_list = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_listen_port = 8776 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_use_ssl = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] osapi_volume_workers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] per_volume_size_limit = -1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] periodic_fuzzy_delay = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] periodic_interval = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] public_endpoint = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] publish_errors = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_backup_gigabytes = 1000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_backups = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_gigabytes = 1000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_groups = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_snapshots = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] quota_volumes = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] rate_limit_burst = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] rate_limit_except_level = CRITICAL {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] rate_limit_interval = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] reinit_driver_count = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] replication_device = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] report_discard_supported = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] report_interval = 120 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] reservation_clean_interval = 86400 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] reservation_expire = 86400 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] reserved_image_namespaces = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] reserved_percentage = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] rpc_response_timeout = 120 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] run_external_periodic_tasks = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] scst_target_driver = iscsi {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] scst_target_iqn_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_down_time = 720 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] shell_completion = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] snapshot_name_template = snapshot-%s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] snapshot_same_host = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] split_loggers = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] state_path = /opt/stack/data/cinder {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] storage_availability_zone = nova {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] storage_protocol = iSCSI {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] syslog_log_facility = LOG_USER {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_helper = lioadm {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_ip_address = 192.168.122.38 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_port = 3260 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_protocol = iscsi {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] target_secondary_ip_addresses = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] trace_flags = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] transport_url = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] until_refresh = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_chap_auth = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_default_quota_class = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_journal = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_json = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_multipath_for_image_xfer = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_stderr = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] use_syslog = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] verify_glance_signatures = enabled {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_api_class = cinder.volume.api.API {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_backend_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_clear = zero {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_clear_ionice = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_clear_size = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_copy_bps_limit = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_dd_blocksize = 1M {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_name_template = volume-%s {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_service_inithost_offload = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volume_usage_audit_period = month {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] zoning_mode = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.auth_section = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.auth_type = password {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.auth_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.cache = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.interface = public {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_password = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcache_username = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.region_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.service_type = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.backend = dogpile.cache.null {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.backend_argument = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.backend_expiration_time = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.config_prefix = cache.oslo {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.debug_cache_backend = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.enable_retry_client = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.enable_socket_keepalive = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.expiration_time = 600 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_dead_retry = 300 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_pool_maxsize = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_sasl_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.password = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.proxies = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.redis_db = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.redis_server = localhost:6379 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.retry_attempts = 2 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.retry_delay = 0.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.socket_keepalive_count = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.socket_keepalive_idle = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.socket_keepalive_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.socket_timeout = 1.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.tls_allowed_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.tls_cafile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.tls_certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.tls_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.tls_keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cache.username = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] coordination.backend_url = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.asyncio_connection = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.asyncio_slave_connection = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.backend = sqlalchemy {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.connection = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.connection_debug = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.connection_parameters = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.connection_recycle_time = 3600 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.connection_trace = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.db_inc_retry_interval = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.db_max_retries = 20 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.db_max_retry_interval = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.db_retry_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.max_overflow = 50 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.max_pool_size = 5 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.max_retries = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.pool_timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.retry_interval = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.slave_connection = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.sqlite_synchronous = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.synchronous_reader = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] database.use_db_reconnect = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_tracing.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.connection_string = messaging:// {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.es_doc_type = notification {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.es_scroll_size = 10000 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.es_scroll_time = 2m {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.filter_error_trace = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.hmac_keys = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.sentinel_service_name = mymaster {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.socket_timeout = 0.1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.trace_requests = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler.trace_sqlalchemy = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler_jaeger.process_tags = {} {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] profiler_otlp.service_name_prefix = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.policy_default_rule = default {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.policy_file = policy.yaml {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.group = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.helper_command = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] privsep_osbrick.user = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.group = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.helper_command = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] cinder_sys_admin.user = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.auth_section = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.auth_type = password {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.cafile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.collect_timing = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.send_service_user_token = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.split_loggers = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.tls_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] service_user.tls_min_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.auth_section = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.auth_type = password {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.collect_timing = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.region_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.split_loggers = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.tls_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] glance.tls_min_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.backend_availability_zone = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.chap_password = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack sudo[76245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 02 16:11:59 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.chap_username = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.disk_geometry = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_client_cert = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_data_namespace = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.driver_use_ssl = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.extra_capabilities = {} {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.filter_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.goodness_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iscsi_target_flags = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iser_helper = tgtadm {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iser_port = 3260 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.lvm_share_target = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.lvm_type = auto {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.replication_device = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.report_discard_supported = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_helper = tgtadm {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_port = 3260 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_protocol = iscsi {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.trace_flags = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.use_chap_auth = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_backend_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_clear = zero {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_reports.file_event_handler = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_reports.log_dir = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.backend_host = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.chap_password = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.chap_username = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.disk_geometry = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_client_cert = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.extra_capabilities = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.filter_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.goodness_function = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iser_helper = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iser_ip_address = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iser_port = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.lvm_share_target = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.lvm_type = auto {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.num_shell_tries = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.replication_device = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.report_discard_supported = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.reserved_percentage = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.scst_target_driver = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.storage_protocol = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_helper = lioadm {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_ip_address = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_port = 3260 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.trace_flags = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.use_chap_auth = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_clear = zero {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_clear_size = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] lvmdriver-1.volumes_dir = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_notifications.driver = [] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] key_manager.fixed_key = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.barbican_api_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.barbican_endpoint = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.barbican_endpoint_type = public {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.barbican_region_name = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.cafile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.collect_timing = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.number_of_retries = 60 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.retry_delay = 1 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.send_service_user_token = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.split_loggers = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.tls_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.tls_min_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.verify_ssl = True {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican.verify_ssl_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.auth_section = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.auth_type = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.cafile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.certfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.collect_timing = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.insecure = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.keyfile = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.split_loggers = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.timeout = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.tls_ciphers = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] barbican_service_user.tls_min_version = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.approle_role_id = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.approle_secret_id = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.auth_method = approle {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.auth_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.kv_mountpoint = secret {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.kv_path = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.kv_version = 2 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.namespace = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.root_token_id = **** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.ssl_ca_crt_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.timeout = 60.0 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.token_file = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.token_role = None {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.use_ssl = False {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:11:59 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] ******************************************************************************** {{(pid=76082) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 16:11:59 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:11:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:11:59 devstack sudo[76334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:11:59 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:00 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.283s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:12:00 devstack cinder-volume[76241]: INFO cinder.brick.local_dev.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:00 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:00 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:00 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG cinder.brick.local_dev.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76241) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:00 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:00 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:00 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:00 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:00 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:01 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:01 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 02 16:12:01 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:01 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:01 devstack sudo[76854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:01 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:01 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:01 devstack sudo[76938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:01 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:01 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack sudo[76941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:02 devstack sudo[76941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:02 devstack sudo[76941]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack sudo[76979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:02 devstack sudo[76979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:02 devstack sudo[76979]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.354s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:02 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:02 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:02 devstack cinder-volume[76241]: INFO cinder.volume.drivers.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:02 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:02 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:03 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:03 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:03 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:03 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:03 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:03 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:03 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:03 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:03 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:03 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:03 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:04 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:04 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:04 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:04 devstack cinder-volume[76241]: INFO cinder.volume.driver [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Driver hasn't implemented _init_vendor_properties() Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG cinder.volume.driver [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76241) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_db.sqlalchemy.engines [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writer thread running {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG cinder.db.api [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Building query based on filter {{(pid=76241) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG cinder.image.image_utils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76241) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 16:12:04 devstack cinder-volume[76241]: INFO cinder.keymgr.migration [None req-55255c35-c934-4f81-8646-fd02650d8a70 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:04 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:04 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:04 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:04 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:04 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:04 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:04 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:05 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:05 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:05 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:05 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:05 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:05 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG cinder.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Notifying Schedulers of capabilities ... {{(pid=76241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:12:05 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Driver initialization completed successfully. Sep 02 16:12:05 devstack cinder-volume[76241]: INFO cinder.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Initiating service 2 cleanup Sep 02 16:12:05 devstack cinder-volume[76241]: INFO cinder.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Service 2 cleanup completed. Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG cinder.service [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Creating RPC server for service cinder-volume {{(pid=76241) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG cinder.service [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76241) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 16:12:05 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:12:05 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:05 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:12:05 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:06 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:06 devstack sudo[77083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:06 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:06 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:06 devstack sudo[77086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:12:06 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:06 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:12:06 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:12:06 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:12:06 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Sep 02 16:12:06 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:12:06 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-410ff54c-b5bd-485f-bc49-4d61b2fce67e None None] Driver post RPC initialization completed successfully. Sep 02 16:12:09 devstack cinder-volume[76082]: DEBUG dbcounter [-] [76082] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:12:14 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writing DB stats cinder:SELECT=3 {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:12:16 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:13:00 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:13:00 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:13:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:13:00 devstack sudo[79061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:13:00 devstack sudo[79061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:13:01 devstack sudo[79061]: pam_unix(sudo:session): session closed for user root Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:13:01 devstack sudo[79092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:13:01 devstack sudo[79092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:13:01 devstack sudo[79092]: pam_unix(sudo:session): session closed for user root Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:13:01 devstack sudo[79099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:13:01 devstack sudo[79099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:13:01 devstack sudo[79099]: pam_unix(sudo:session): session closed for user root Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:13:01 devstack sudo[79102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:13:01 devstack sudo[79102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:13:01 devstack sudo[79102]: pam_unix(sudo:session): session closed for user root Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG cinder.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Notifying Schedulers of capabilities ... {{(pid=76241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager._thread_info {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread count: 6 {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:13:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread info: [<_MainThread(MainThread, started 140332988874880)>, , , , , ] {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:14:00 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:14:00 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:14:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:14:00 devstack sudo[82398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:14:00 devstack sudo[82398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:14:01 devstack sudo[82398]: pam_unix(sudo:session): session closed for user root Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:14:01 devstack sudo[82401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:14:01 devstack sudo[82401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:14:01 devstack sudo[82401]: pam_unix(sudo:session): session closed for user root Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:14:01 devstack sudo[82405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:14:01 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:14:01 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:14:01 devstack sudo[82408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:14:01 devstack sudo[82408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:14:01 devstack sudo[82408]: pam_unix(sudo:session): session closed for user root Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:14:01 devstack cinder-volume[76241]: DEBUG cinder.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Notifying Schedulers of capabilities ... {{(pid=76241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:14:16 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:15:00 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:15:00 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:15:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:15:00 devstack sudo[84476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:15:00 devstack sudo[84476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:15:01 devstack sudo[84476]: pam_unix(sudo:session): session closed for user root Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:15:01 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:15:01 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:15:01 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:15:01 devstack sudo[84499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:15:01 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:15:01 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:15:01 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:15:01 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:15:01 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG cinder.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Notifying Schedulers of capabilities ... {{(pid=76241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager._thread_info {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread count: 6 {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:15:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread info: [<_MainThread(MainThread, started 140332988874880)>, , , , , ] {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:16:00 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:16:00 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Updating volume stats {{(pid=76241) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 16:16:00 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:00 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 16:16:00 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:01 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:01 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:16:01 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:01 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:01 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 16:16:01 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:01 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:01 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 16:16:01 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:01 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG cinder.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Notifying Schedulers of capabilities ... {{(pid=76241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG oslo_service.periodic_task [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] Running periodic task VolumeManager._thread_info {{(pid=76241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread count: 6 {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:16:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-b5dbad2c-d49d-4e04-8a15-ec086f9b517f None None] thread info: [<_MainThread(MainThread, started 140332988874880)>, , , , , ] {{(pid=76241) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:16:14 devstack cinder-volume[76082]: INFO oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Caught SIGTERM, stopping children Sep 02 16:16:14 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Acquiring lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:14 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Acquired lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:14 devstack cinder-volume[76082]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Releasing lock "singleton_lock" {{(pid=76082) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:14 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Stop services. {{(pid=76082) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 16:16:14 devstack cinder-volume[76082]: DEBUG oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Killing children. {{(pid=76082) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 16:16:14 devstack cinder-volume[76082]: INFO oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Waiting on 1 children to exit Sep 02 16:16:15 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Acquiring lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:15 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Acquired lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:15 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Releasing lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:15 devstack cinder-volume[76241]: WARNING amqp [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 16:16:15 devstack cinder-volume[76241]: WARNING amqp [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 16:16:15 devstack cinder-volume[76082]: INFO oslo_service.backend._eventlet.service [None req-ae459733-2dc4-40ad-8740-bb06047153e7 None None] Child 76241 exited with status 0 Sep 02 16:16:16 devstack cinder-volume[86222]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 16:16:16 devstack cinder-volume[86222]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 16:16:16 devstack cinder-volume[86222]: we strongly recommend against using it for new projects. Sep 02 16:16:16 devstack cinder-volume[86222]: If you are already using Eventlet, we recommend migrating to a different Sep 02 16:16:16 devstack cinder-volume[86222]: framework. For more detail see Sep 02 16:16:16 devstack cinder-volume[86222]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 16:16:16 devstack cinder-volume[86222]: import eventlet # noqa Sep 02 16:16:18 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:18 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:18 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:18 devstack cinder-volume[86222]: INFO dbcounter [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Registered counter for database cinder Sep 02 16:16:18 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG dbcounter [-] [86222] Writer thread running {{(pid=86222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:16:19 devstack cinder-volume[86222]: INFO cinder.rpc [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 16:16:19 devstack cinder-volume[86222]: INFO cinder.rpc [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:19 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Determined volume DB was empty at startup. Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG cinder.volume.manager [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86222) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 16:16:19 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 16:16:19 devstack cinder-volume[86222]: WARNING stevedore.named [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 16:16:19 devstack cinder-volume[86222]: WARNING castellan.key_manager [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:16:19 devstack cinder-volume[86222]: WARNING cinder.keymgr.conf_key_mgr [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:16:19 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:19 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Starting 1 workers Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Started child 86438 {{(pid=86222) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Full set of CONF: {{(pid=86222) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Configuration options gathered from: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] ================================================================================ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] allow_availability_zone_fallback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] allow_compression_on_image_upload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] allowed_direct_url_schemes = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] api_rate_limit = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] auth_strategy = keystone {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_stats_polling_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backup_api_class = cinder.backup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backup_name_template = backup-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backup_use_same_host = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86438]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_internal_tenant_project_id = d9b8f93d3cf649549f242bab8e7e7613 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_internal_tenant_user_id = f77e576b54b64ee9a2f948d8ae9996d5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cluster = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] compression_format = gzip {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] compute_api_class = cinder.compute.nova.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] config_dir = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] config_source = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] control_exchange = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] debug = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] default_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] default_group_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] default_volume_type = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] enable_new_services = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] enabled_backends = ['QuobyteHD'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_api_insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_api_ssl_compression = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_ca_certificates_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_catalog_info = image:glance:publicURL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_num_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance_request_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] graceful_shutdown_timeout = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] group_api_class = cinder.group.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] host = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_compress_on_upload = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_conversion_address_space_limit = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_conversion_cpu_limit = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_conversion_disable = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] init_host_max_objects_retrieval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] instance_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iser_ip_address = 192.168.122.38 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_color = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_config_append = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_options = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_rotate_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_rotate_interval_type = days {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] log_rotation_type = none {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] max_age = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] max_logfile_count = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] max_logfile_size_mb = 200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] message_reap_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] message_ttl = 2592000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] migration_create_volume_timeout_secs = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] monkey_patch = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] monkey_patch_modules = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] my_ip = 192.168.122.38 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] no_snapshot_gb_quota = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_max_limit = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_ext_list = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_listen_port = 8776 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] osapi_volume_workers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] per_volume_size_limit = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] periodic_fuzzy_delay = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] periodic_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] public_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] publish_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_backup_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_backups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_groups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_snapshots = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] quota_volumes = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] rate_limit_burst = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] rate_limit_except_level = CRITICAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] rate_limit_interval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] reinit_driver_count = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] report_interval = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] reservation_clean_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] reservation_expire = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] reserved_image_namespaces = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] rpc_response_timeout = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] run_external_periodic_tasks = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_down_time = 720 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] shell_completion = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] snapshot_name_template = snapshot-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] state_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] storage_availability_zone = nova {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] syslog_log_facility = LOG_USER {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_helper = lioadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_ip_address = 192.168.122.38 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] until_refresh = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_default_quota_class = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_journal = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_json = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_stderr = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] use_syslog = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] verify_glance_signatures = enabled {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_api_class = cinder.volume.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_name_template = volume-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_service_inithost_offload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volume_usage_audit_period = month {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] zoning_mode = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_concurrency.disable_process_locking = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.auth_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.include_service_catalog = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.interface = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86438]: INFO cinder.volume.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.remotefs [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86438) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcache_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.service_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.backend = dogpile.cache.null {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.backend_argument = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.backend_expiration_time = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.config_prefix = cache.oslo {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.debug_cache_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.enable_retry_client = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.enable_socket_keepalive = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.expiration_time = 600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.hashclient_retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.proxies = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.redis_db = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.redis_server = localhost:6379 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.retry_delay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.socket_keepalive_count = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.socket_keepalive_idle = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.socket_keepalive_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.socket_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cache.username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] coordination.backend_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.asyncio_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.asyncio_slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.backend = sqlalchemy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.connection_debug = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.connection_parameters = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.connection_recycle_time = 3600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.connection_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.db_inc_retry_interval = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.db_max_retries = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.db_max_retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.db_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.max_overflow = 50 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.max_pool_size = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.max_retries = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.mysql_wsrep_sync_wait = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.pool_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.sqlite_synchronous = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.synchronous_reader = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] database.use_db_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_tracing.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.connection_string = messaging:// {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.es_doc_type = notification {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.es_scroll_size = 10000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.es_scroll_time = 2m {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.filter_error_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.hmac_keys = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.socket_timeout = 0.1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.trace_requests = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler.trace_sqlalchemy = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler_jaeger.process_tags = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler_jaeger.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] profiler_otlp.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.enforce_new_defaults = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.policy_default_rule = default {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.policy_file = policy.yaml {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] privsep_osbrick.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] cinder_sys_admin.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.send_service_user_token = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] glance.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.extra_capabilities = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_host = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_login = admin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_private_key = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_share_path = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.quobyte_volume_url = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.unique_fqdn_network = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_reports.file_event_handler = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_reports.log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.chap_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.chiscsi_conf = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.driver_use_ssl = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.extra_capabilities = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iser_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iser_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iser_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.iser_target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_login = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_private_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_share_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_ssh_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.num_shell_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.nvmet_port_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86438) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 16:16:19 devstack cinder-volume[86438]: WARNING cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86438]: WARNING cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.report_discard_supported = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Running cmd (subprocess): mount.quobyte {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.reserved_percentage = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.scst_target_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.storage_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.use_chap_auth = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_clear = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_clear_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] QuobyteHD.volumes_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_notifications.driver = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_notifications.retry = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] key_manager.fixed_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.barbican_api_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.barbican_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.barbican_endpoint_type = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.barbican_region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.number_of_retries = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.retry_delay = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.send_service_user_token = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.verify_ssl = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican.verify_ssl_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.auth_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] barbican_service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.approle_role_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.approle_secret_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.auth_method = approle {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.auth_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.kv_mountpoint = secret {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.kv_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.kv_version = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.root_token_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.token_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.token_role = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:19 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 16:16:19 devstack quobyte-client[86439]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 16:16:19 devstack quobyte-client[86439]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=86438) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:19 devstack cinder-volume[86438]: INFO cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd ... Sep 02 16:16:19 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca -c /etc/quobyte/client-cinder.cfg {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:19 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca -c /etc/quobyte/client-cinder.cfg Sep 02 16:16:19 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:20 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.417s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd succeeded Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=86438) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.435s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:20 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:20 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:20 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.243s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.volume.driver [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Driver hasn't implemented _init_vendor_properties() Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.volume.driver [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8112449645996, 'free_capacity_gb': 1773.8112449645996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86438) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_db.sqlalchemy.engines [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86438) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG dbcounter [-] [86438] Writer thread running {{(pid=86438) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.db.api [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Building query based on filter {{(pid=86438) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.image.image_utils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86438) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.keymgr.migration [None req-ef4bd666-6097-4111-bb39-e62e094acff7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=86438) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=86438) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:20 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:20 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:20 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.236s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Notifying Schedulers of capabilities ... {{(pid=86438) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.volume.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Driver initialization completed successfully. Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Initiating service 3 cleanup Sep 02 16:16:20 devstack cinder-volume[86438]: INFO cinder.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Service 3 cleanup completed. Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.service [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Creating RPC server for service cinder-volume {{(pid=86438) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 16:16:20 devstack cinder-volume[86438]: DEBUG cinder.service [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86438) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 16:16:21 devstack cinder-volume[86438]: INFO cinder.volume.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=86438) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=86438) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:21 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:21 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:21 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:21 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.303s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:21 devstack cinder-volume[86438]: INFO cinder.volume.manager [None req-af1de098-b053-4b45-8f64-5c3f7ee39511 None None] Driver post RPC initialization completed successfully. Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=86438) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG cinder.volume.drivers.quobyte [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=86438) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86438) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:25 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:25 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:25 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG oslo_concurrency.processutils [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.232s {{(pid=86438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:25 devstack cinder-volume[86438]: DEBUG cinder.manager [None req-5e0d4b58-a691-4e04-ade8-b6427f7680f5 None None] Notifying Schedulers of capabilities ... {{(pid=86438) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:16:26 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Caught SIGTERM, stopping children Sep 02 16:16:26 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:26 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:26 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:26 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Stop services. {{(pid=86222) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 16:16:26 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Killing children. {{(pid=86222) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 16:16:26 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Waiting on 1 children to exit Sep 02 16:16:29 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Acquiring lock "singleton_lock" {{(pid=86438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:29 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Acquired lock "singleton_lock" {{(pid=86438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:29 devstack cinder-volume[86438]: DEBUG oslo_concurrency.lockutils [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Releasing lock "singleton_lock" {{(pid=86438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:29 devstack cinder-volume[86438]: WARNING amqp [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 16:16:29 devstack cinder-volume[86438]: WARNING amqp [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 16:16:29 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-9f72bf42-4830-4d1c-95e3-671a2487a787 None None] Child 86438 exited with status 0 Sep 02 16:16:29 devstack cinder-volume[86755]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 16:16:29 devstack cinder-volume[86755]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 16:16:29 devstack cinder-volume[86755]: we strongly recommend against using it for new projects. Sep 02 16:16:29 devstack cinder-volume[86755]: If you are already using Eventlet, we recommend migrating to a different Sep 02 16:16:29 devstack cinder-volume[86755]: framework. For more detail see Sep 02 16:16:29 devstack cinder-volume[86755]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 16:16:29 devstack cinder-volume[86755]: import eventlet # noqa Sep 02 16:16:33 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 16:16:33 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 16:16:33 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 16:16:33 devstack cinder-volume[86755]: INFO dbcounter [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Registered counter for database cinder Sep 02 16:16:33 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG dbcounter [-] [86755] Writer thread running {{(pid=86755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:16:34 devstack cinder-volume[86755]: INFO cinder.rpc [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 16:16:34 devstack cinder-volume[86755]: INFO cinder.rpc [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:34 devstack cinder-volume[86755]: INFO cinder.volume.manager [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Determined volume DB was empty at startup. Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG cinder.volume.manager [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86755) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 16:16:34 devstack cinder-volume[86755]: WARNING stevedore.named [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 16:16:34 devstack cinder-volume[86755]: WARNING castellan.key_manager [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:16:34 devstack cinder-volume[86755]: WARNING cinder.keymgr.conf_key_mgr [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 16:16:34 devstack cinder-volume[86755]: INFO cinder.volume.manager [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:34 devstack cinder-volume[86755]: INFO oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Starting 1 workers Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Started child 87051 {{(pid=86755) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Full set of CONF: {{(pid=86755) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] ******************************************************************************** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] Configuration options gathered from: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] ================================================================================ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] allow_availability_zone_fallback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] allow_compression_on_image_upload = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] allowed_direct_url_schemes = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] api_rate_limit = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] auth_strategy = keystone {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_stats_polling_interval = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backup_api_class = cinder.backup.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backup_name_template = backup-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backup_use_same_host = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[87051]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backup_use_temp_snapshot = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] chap_username = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_internal_tenant_project_id = d9b8f93d3cf649549f242bab8e7e7613 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_internal_tenant_user_id = f77e576b54b64ee9a2f948d8ae9996d5 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cluster = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] compression_format = gzip {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] compute_api_class = cinder.compute.nova.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] config_dir = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] config_source = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] control_exchange = openstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] debug = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] default_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] default_group_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] default_volume_type = QuobyteHD {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_ssl_cert_verify = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] driver_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] enable_new_services = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] enable_unsupported_driver = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] enabled_backends = ['QuobyteHD'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] enforce_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_api_insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_api_ssl_compression = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_ca_certificates_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_catalog_info = image:glance:publicURL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_num_retries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance_request_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] graceful_shutdown_timeout = 5 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] group_api_class = cinder.group.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] host = devstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_compress_on_upload = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_conversion_address_space_limit = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_conversion_cpu_limit = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_conversion_disable = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_upload_use_cinder_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_upload_use_internal_tenant = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_volume_cache_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_volume_cache_max_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] image_volume_cache_max_size_gb = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] init_host_max_objects_retrieval = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] instance_format = [instance: %(uuid)s] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iscsi_target_flags = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iscsi_write_cache = on {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iser_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iser_ip_address = 192.168.122.38 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iser_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_color = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_config_append = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_options = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_rotate_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_rotate_interval_type = days {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] log_rotation_type = none {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] max_age = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] max_logfile_count = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] max_logfile_size_mb = 200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] max_over_subscription_ratio = 20.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] message_reap_interval = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] message_ttl = 2592000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] migration_create_volume_timeout_secs = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] monkey_patch = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] monkey_patch_modules = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] my_ip = 192.168.122.38 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] no_snapshot_gb_quota = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] num_iser_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] num_shell_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] num_volume_device_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] nvmeof_conn_info_version = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] nvmet_ns_id = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] nvmet_port_id = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_max_limit = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_ext_list = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_listen_port = 8776 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] osapi_volume_workers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] per_volume_size_limit = -1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] periodic_fuzzy_delay = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] periodic_interval = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] public_endpoint = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] publish_errors = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_backup_gigabytes = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_backups = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_gigabytes = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_groups = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_snapshots = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] quota_volumes = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] rate_limit_burst = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] rate_limit_except_level = CRITICAL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] rate_limit_interval = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] reinit_driver_count = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] report_discard_supported = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] report_interval = 120 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] reservation_clean_interval = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] reservation_expire = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] reserved_image_namespaces = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] reserved_percentage = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] rpc_response_timeout = 120 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] run_external_periodic_tasks = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] scst_target_driver = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_down_time = 720 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] shell_completion = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] snapshot_name_template = snapshot-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] state_path = /opt/stack/data/cinder {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] storage_availability_zone = nova {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] storage_protocol = iSCSI {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] syslog_log_facility = LOG_USER {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_helper = lioadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_ip_address = 192.168.122.38 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_protocol = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] target_secondary_ip_addresses = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] transport_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] until_refresh = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_chap_auth = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_default_quota_class = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_journal = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_json = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_stderr = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] use_syslog = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] verify_glance_signatures = enabled {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_api_class = cinder.volume.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_clear = zero {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_clear_size = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_copy_bps_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_dd_blocksize = 1M {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_name_template = volume-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_service_inithost_offload = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volume_usage_audit_period = month {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] zoning_mode = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_concurrency.disable_process_locking = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.auth_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.include_service_catalog = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87051) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.interface = public {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcache_username = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.service_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.backend = dogpile.cache.null {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.backend_argument = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.backend_expiration_time = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.config_prefix = cache.oslo {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.debug_cache_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.enable_retry_client = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.enable_socket_keepalive = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.expiration_time = 600 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.hashclient_retry_attempts = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_dead_retry = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_pool_maxsize = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_sasl_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.proxies = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.redis_db = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.redis_server = localhost:6379 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.retry_attempts = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.retry_delay = 0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.socket_keepalive_count = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.socket_keepalive_idle = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.socket_keepalive_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.socket_timeout = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.tls_allowed_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.tls_cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.tls_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.tls_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.tls_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cache.username = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] coordination.backend_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.asyncio_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.asyncio_slave_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.backend = sqlalchemy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.connection_debug = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.connection_parameters = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.connection_recycle_time = 3600 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.connection_trace = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.db_inc_retry_interval = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.db_max_retries = 20 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.db_max_retry_interval = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.db_retry_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.max_overflow = 50 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.max_pool_size = 5 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.max_retries = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.mysql_wsrep_sync_wait = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.pool_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.retry_interval = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.slave_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.sqlite_synchronous = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.synchronous_reader = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] database.use_db_reconnect = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_tracing.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.connection_string = messaging:// {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.es_doc_type = notification {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.es_scroll_size = 10000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.es_scroll_time = 2m {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.filter_error_trace = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.hmac_keys = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.sentinel_service_name = mymaster {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.socket_timeout = 0.1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.trace_requests = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler.trace_sqlalchemy = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler_jaeger.process_tags = {} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler_jaeger.service_name_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] profiler_otlp.service_name_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.enforce_new_defaults = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.policy_default_rule = default {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.policy_file = policy.yaml {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.group = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.helper_command = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] privsep_osbrick.user = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.group = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.helper_command = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] cinder_sys_admin.user = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.send_service_user_token = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.tls_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] service_user.tls_min_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.tls_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] glance.tls_min_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.chap_username = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.driver_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.extra_capabilities = {} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iscsi_target_flags = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iscsi_write_cache = on {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iser_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iser_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_host = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_login = admin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_mount_options = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_private_key = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_share_path = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.num_shell_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.quobyte_volume_url = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.report_discard_supported = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.reserved_percentage = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_protocol = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.unique_fqdn_network = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.use_chap_auth = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_clear = zero {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_clear_size = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_reports.file_event_handler = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_reports.log_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.backend_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.chap_username = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.chiscsi_conf = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.driver_use_ssl = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.extra_capabilities = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iser_helper = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iser_ip_address = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iser_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.iser_target_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_login = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_mount_options = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_private_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_share_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_ssh_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.num_shell_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.nvmet_port_id = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.report_discard_supported = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.reserved_percentage = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.scst_target_driver = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.storage_protocol = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_helper = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_ip_address = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_protocol = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.use_chap_auth = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_clear = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_clear_size = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] QuobyteHD.volumes_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87051) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 16:16:34 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_notifications.driver = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_notifications.retry = -1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] key_manager.fixed_key = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Running cmd (subprocess): mount.quobyte {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.barbican_api_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.barbican_endpoint = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.barbican_endpoint_type = public {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.barbican_region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.number_of_retries = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.retry_delay = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.send_service_user_token = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.tls_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.tls_min_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.verify_ssl = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican.verify_ssl_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.auth_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.tls_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] barbican_service_user.tls_min_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.approle_role_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.approle_secret_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.auth_method = approle {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.auth_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.kv_mountpoint = secret {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.kv_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.kv_version = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.root_token_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.ssl_ca_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.token_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.token_role = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 16:16:34 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-24baed4c-0993-44d6-9125-433ddc43a095 None None] ******************************************************************************** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 16:16:34 devstack quobyte-client[87060]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 16:16:34 devstack quobyte-client[87060]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:34 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:34 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:34 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.222s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:34 devstack cinder-volume[87051]: INFO cinder.volume.driver [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Driver hasn't implemented _init_vendor_properties() Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.driver [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7958145141602, 'free_capacity_gb': 1773.7958145141602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87051) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_db.sqlalchemy.engines [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writer thread running {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.db.api [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Building query based on filter {{(pid=87051) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87051) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:34 devstack cinder-volume[87051]: INFO cinder.keymgr.migration [None req-bb8b15ae-9003-4723-920f-ecf7a1f5b441 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 16:16:34 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:34 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:35 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.233s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:16:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Driver initialization completed successfully. Sep 02 16:16:35 devstack cinder-volume[87051]: INFO cinder.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Initiating service 3 cleanup Sep 02 16:16:35 devstack cinder-volume[87051]: INFO cinder.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Service 3 cleanup completed. Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG cinder.service [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Creating RPC server for service cinder-volume {{(pid=87051) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG cinder.service [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87051) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 16:16:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:16:35 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:16:35 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:16:35 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Sep 02 16:16:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:16:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aae2a278-4ff6-4f4f-8e56-a9671b6c6f27 None None] Driver post RPC initialization completed successfully. Sep 02 16:16:44 devstack cinder-volume[86755]: DEBUG dbcounter [-] [86755] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:16:45 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:16:45 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=2 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:16:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:16:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 6 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:16:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:17:33 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:17:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Flow 'volume_create_manager' (50d744fe-9199-45ef-bfcf-9e7e13a6c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:17:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f9a72f-da3e-4407-a7f7-903e34c05442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f9a72f-da3e-4407-a7f7-903e34c05442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1711093671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3cadb2-aef1-4819-ab7f-c5c5bad5060c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd22341c90440a792a0762e545b5911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:17:34Z,use_quota=True,user_id='32d1a0afb4cd4a418bf373b650bf1b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818b105-5795-41ba-9a97-e05713b86df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818b105-5795-41ba-9a97-e05713b86df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30fd2b2-12fd-44ab-af01-1ce9488cee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30fd2b2-12fd-44ab-af01-1ce9488cee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3cadb2-aef1-4819-ab7f-c5c5bad5060c', 'volume_name': 'volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e0c929-56b7-4123-aede-530e22510621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e0c929-56b7-4123-aede-530e22510621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57699f39-49f0-4f29-ba86-01b0c4cbd372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Volume 5f3cadb2-aef1-4819-ab7f-c5c5bad5060c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c', 'volume_size': 1} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1711093671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3cadb2-aef1-4819-ab7f-c5c5bad5060c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd22341c90440a792a0762e545b5911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:17:34Z,use_quota=True,user_id='32d1a0afb4cd4a418bf373b650bf1b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Creating volume 5f3cadb2-aef1-4819-ab7f-c5c5bad5060c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:17:34 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:17:34 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c 1073741824 Sep 02 16:17:34 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:17:34 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c 1073741824" returned: 0 in 0.574s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:17:34 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c Sep 02 16:17:34 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:17:34 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57699f39-49f0-4f29-ba86-01b0c4cbd372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3760967f-dc53-44ef-8e03-ef67479ee095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Volume volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c (5f3cadb2-aef1-4819-ab7f-c5c5bad5060c): created successfully Sep 02 16:17:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3760967f-dc53-44ef-8e03-ef67479ee095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Flow 'volume_create_manager' (50d744fe-9199-45ef-bfcf-9e7e13a6c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:17:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-03783205-a82e-4e22-b422-472460bdc236 tempest-TaggedAttachmentsTest-2046738692 None] Created volume successfully. Sep 02 16:17:45 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:17:45 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:17:48 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:17:48 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:17:49 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Sep 02 16:17:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:17:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:17:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:17:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 6 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:17:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Flow 'volume_create_manager' (c39e2dcd-3908-4009-8f87-7a8908a85d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7f83ca-3eda-4088-b313-f0a382fc5188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7f83ca-3eda-4088-b313-f0a382fc5188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2094398699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ef874e-73d7-43e1-95f3-83227c3208a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0a90bddddd45d0b73013fe403654b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:17:50Z,use_quota=True,user_id='9fbee7dca1f24adeb0bc1cafd27646e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33edafd2-90a0-462a-9870-fc245561cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33edafd2-90a0-462a-9870-fc245561cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d951cf0-5f64-4bbd-b798-d98cdbcfa955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d951cf0-5f64-4bbd-b798-d98cdbcfa955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ef874e-73d7-43e1-95f3-83227c3208a6', 'volume_name': 'volume-48ef874e-73d7-43e1-95f3-83227c3208a6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9886a23-ef80-490c-a853-2ec68ba33a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9886a23-ef80-490c-a853-2ec68ba33a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67be95e3-1ab0-4e21-87e2-ade2abf844ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Volume 48ef874e-73d7-43e1-95f3-83227c3208a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ef874e-73d7-43e1-95f3-83227c3208a6', 'volume_size': 1} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2094398699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ef874e-73d7-43e1-95f3-83227c3208a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0a90bddddd45d0b73013fe403654b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:17:50Z,use_quota=True,user_id='9fbee7dca1f24adeb0bc1cafd27646e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Creating volume 48ef874e-73d7-43e1-95f3-83227c3208a6 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:17:50 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:17:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:17:50 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 1073741824 Sep 02 16:17:50 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:17:51 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 1073741824" returned: 0 in 0.918s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:17:51 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 Sep 02 16:17:51 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:17:51 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67be95e3-1ab0-4e21-87e2-ade2abf844ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ef874e-73d7-43e1-95f3-83227c3208a6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849b02a-1f4f-46ec-a10a-72e50c8668cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:17:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Volume volume-48ef874e-73d7-43e1-95f3-83227c3208a6 (48ef874e-73d7-43e1-95f3-83227c3208a6): created successfully Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849b02a-1f4f-46ec-a10a-72e50c8668cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:17:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Flow 'volume_create_manager' (c39e2dcd-3908-4009-8f87-7a8908a85d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:17:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-78005e41-0051-48b5-8da8-93bdfaf07cd4 tempest-DeleteServersTestJSON-399172952 None] Created volume successfully. Sep 02 16:17:56 devstack cinder-volume[87051]: WARNING py.warnings [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 02 16:17:56 devstack cinder-volume[87051]: .first() Sep 02 16:17:56 devstack cinder-volume[87051]: Sep 02 16:17:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:17:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:17:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:17:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-48ef874e-73d7-43e1-95f3-83227c3208a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d29105c-958a-4758-b0f0-24b0bb5e17b5', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:17:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-ba8c5257-6f7a-4d2f-928b-ac9e1efe2783 req-5bd57267-6eea-418b-8610-10b6ea4a5a7a tempest-DeleteServersTestJSON-399172952 None] attachment_update completed successfully. Sep 02 16:18:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-dfc90417-3b85-477c-9a79-2632173faa1b req-e12c5920-ffcf-48d8-a5fc-494d09eab15e tempest-DeleteServersTestJSON-399172952 None] Terminate volume connection completed successfully. Sep 02 16:18:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-dfc90417-3b85-477c-9a79-2632173faa1b req-e12c5920-ffcf-48d8-a5fc-494d09eab15e tempest-DeleteServersTestJSON-399172952 None] Deleting attachment 4d29105c-958a-4758-b0f0-24b0bb5e17b5. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Flow 'volume_create_manager' (1d677176-c08b-4450-b2b3-ede82239198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2db88e3-e4f6-4efc-a3b4-816e9f978ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2db88e3-e4f6-4efc-a3b4-816e9f978ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-335501093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38afc878-bd8e-49ff-bb39-6011e95efc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ee97872608439096fc61b10b1faa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:18:05Z,use_quota=True,user_id='2edfd37ff1b64cc2832b4176bfb07050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81531472-4bc3-4bbf-a2ae-379c92b7b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81531472-4bc3-4bbf-a2ae-379c92b7b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69f5a6-4065-45b9-bc01-4219c2bf94a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69f5a6-4065-45b9-bc01-4219c2bf94a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38afc878-bd8e-49ff-bb39-6011e95efc38', 'volume_name': 'volume-38afc878-bd8e-49ff-bb39-6011e95efc38', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4f9a7c-937b-42fd-b4d2-4cd049581cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4f9a7c-937b-42fd-b4d2-4cd049581cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9c596c-3f31-4a1e-b924-33dc522a3bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Volume 38afc878-bd8e-49ff-bb39-6011e95efc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38afc878-bd8e-49ff-bb39-6011e95efc38', 'volume_size': 1} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-335501093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38afc878-bd8e-49ff-bb39-6011e95efc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ee97872608439096fc61b10b1faa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:18:05Z,use_quota=True,user_id='2edfd37ff1b64cc2832b4176bfb07050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Creating volume 38afc878-bd8e-49ff-bb39-6011e95efc38 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:18:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:05 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 1073741824 Sep 02 16:18:05 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "cinder-48ef874e-73d7-43e1-95f3-83227c3208a6-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "cinder-48ef874e-73d7-43e1-95f3-83227c3208a6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "cinder-quobyte-48ef874e-73d7-43e1-95f3-83227c3208a6" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:18:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "cinder-quobyte-48ef874e-73d7-43e1-95f3-83227c3208a6" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:18:05 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpds7a300g/privsep.sock'] Sep 02 16:18:05 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpds7a300g/privsep.sock Sep 02 16:18:05 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:06 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 1073741824" returned: 0 in 0.873s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:06 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 Sep 02 16:18:06 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:06 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38" returned: 0 in 0.856s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:18:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9c596c-3f31-4a1e-b924-33dc522a3bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38afc878-bd8e-49ff-bb39-6011e95efc38', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb5ff9d-c15c-4284-a147-79a4e3df4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:18:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Volume volume-38afc878-bd8e-49ff-bb39-6011e95efc38 (38afc878-bd8e-49ff-bb39-6011e95efc38): created successfully Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb5ff9d-c15c-4284-a147-79a4e3df4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Flow 'volume_create_manager' (1d677176-c08b-4450-b2b3-ede82239198c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:18:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ed0ce387-7380-4ff0-9bb1-91003b9745c7 tempest-VolumesAdminNegativeTest-440835288 None] Created volume successfully. Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 16:18:07 devstack cinder-volume[87051]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 02 16:18:07 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:07 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Spawned new privsep daemon via rootwrap Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Accepted privsep connection to /tmp/tmpds7a300g/privsep.sock {{(pid=87051) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 02 16:18:07 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 02 16:18:07 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 02 16:18:07 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 02 16:18:07 devstack cinder-volume[87051]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88698 Sep 02 16:18:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b9f915-c1f3-403e-9321-5d29aff92e34]: (2,) {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:18:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ac8b2-b3f1-49d4-b9e1-4e894ebd2b1b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:18:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:08 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 Sep 02 16:18:08 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:08 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6" returned: 0 in 0.526s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:08 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6 Sep 02 16:18:08 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Acquiring lock "cinder-38afc878-bd8e-49ff-bb39-6011e95efc38-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "cinder-38afc878-bd8e-49ff-bb39-6011e95efc38-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Acquiring lock "cinder-quobyte-38afc878-bd8e-49ff-bb39-6011e95efc38" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "cinder-quobyte-38afc878-bd8e-49ff-bb39-6011e95efc38" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:18:09 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48ef874e-73d7-43e1-95f3-83227c3208a6" returned: 0 in 0.684s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e33ef-8789-45c2-a99c-124e8b86fcbb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "cinder-quobyte-48ef874e-73d7-43e1-95f3-83227c3208a6" released by "delete_volume" :: held 3.378s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:18:09 devstack cinder-volume[87051]: WARNING cinder.quota [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:18:09 devstack cinder-volume[87051]: WARNING cinder.quota [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Created reservations ['9e9aab31-354f-4879-9145-566806b53ef8', '0450b940-2912-49b5-b416-4e3bf36f16e4', '1a9e59d2-8c44-4dd4-8f7f-eb63b5c0f2b7', 'b03e9947-ee94-449b-bf6f-ba3463e03869'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:18:09 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 Sep 02 16:18:09 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:09 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:18:09 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:10 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38" returned: 0 in 0.812s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:10 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38 Sep 02 16:18:10 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:10 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.542s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:18:10 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Deleted volume successfully. Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-519964dc-9b7d-411b-bc4d-b9ce1788dedc tempest-DeleteServersTestJSON-399172952 None] Lock "cinder-48ef874e-73d7-43e1-95f3-83227c3208a6-delete_volume" released by "delete_volume" :: held 4.653s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:18:10 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-38afc878-bd8e-49ff-bb39-6011e95efc38" returned: 0 in 0.602s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "cinder-quobyte-38afc878-bd8e-49ff-bb39-6011e95efc38" released by "delete_volume" :: held 1.519s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Created reservations ['59294058-faef-4911-a52d-7cf330454fe2', '0f2e9748-badd-4f27-84be-a99237f1130c', '20a9027d-5f26-48d6-a56c-b14c55ebca7b', 'e4dd9903-63f2-42b1-949a-a74cf49be377'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:11 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:18:11 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:11 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.549s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:11 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:18:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Deleted volume successfully. Sep 02 16:18:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3c45e7c4-785e-4e27-8a1a-c2fc16a622d5 tempest-VolumesAdminNegativeTest-440835288 None] Lock "cinder-38afc878-bd8e-49ff-bb39-6011e95efc38-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:18:20 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=5 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:18:21 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:18:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0d3c2991-ab61-44d8-88f1-5bc2c3235c80 req-e3992820-6cde-4769-a2c6-10dd8a3b827e tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0d3c2991-ab61-44d8-88f1-5bc2c3235c80 req-e3992820-6cde-4769-a2c6-10dd8a3b827e tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0d3c2991-ab61-44d8-88f1-5bc2c3235c80 req-e3992820-6cde-4769-a2c6-10dd8a3b827e tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-0d3c2991-ab61-44d8-88f1-5bc2c3235c80 req-e3992820-6cde-4769-a2c6-10dd8a3b827e tempest-TaggedAttachmentsTest-2046738692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1df013c4-07fc-4dc2-b4a7-7752b3fd671b', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:18:45 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-0d3c2991-ab61-44d8-88f1-5bc2c3235c80 req-e3992820-6cde-4769-a2c6-10dd8a3b827e tempest-TaggedAttachmentsTest-2046738692 None] attachment_update completed successfully. Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:18:48 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:18:48 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:18:48 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:18:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:18:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-950b10b5-d9ce-4ee7-8a2a-a1bf72702d44 req-fae6457d-e601-4dc3-b22c-98e534e37520 tempest-TaggedAttachmentsTest-2046738692 None] Terminate volume connection completed successfully. Sep 02 16:18:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-950b10b5-d9ce-4ee7-8a2a-a1bf72702d44 req-fae6457d-e601-4dc3-b22c-98e534e37520 tempest-TaggedAttachmentsTest-2046738692 None] Deleting attachment 1df013c4-07fc-4dc2-b4a7-7752b3fd671b. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:19:00 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:19:00 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Flow 'volume_create_manager' (694620a2-c2d8-4eee-aaba-adad89c51a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277fdb3f-5dc3-41a3-9947-d7d896e7696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277fdb3f-5dc3-41a3-9947-d7d896e7696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1080353806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78de8a47-63b0-4537-bcff-125f2c44b006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7648f33c5c4f30a49eb226784e158a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:14Z,use_quota=True,user_id='380d7cd8d5cc4a1fbab1306ed15d35e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94de22e7-a0ea-4792-8cef-fa7e611fd1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94de22e7-a0ea-4792-8cef-fa7e611fd1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21d0f87-302a-4a0e-ac0c-438206e50c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21d0f87-302a-4a0e-ac0c-438206e50c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78de8a47-63b0-4537-bcff-125f2c44b006', 'volume_name': 'volume-78de8a47-63b0-4537-bcff-125f2c44b006', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f9214-2f10-4ab4-b760-615e64969ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f9214-2f10-4ab4-b760-615e64969ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24044272-cd26-4f3d-aa02-ba3a8dad4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Volume 78de8a47-63b0-4537-bcff-125f2c44b006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78de8a47-63b0-4537-bcff-125f2c44b006', 'volume_size': 1} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1080353806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78de8a47-63b0-4537-bcff-125f2c44b006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7648f33c5c4f30a49eb226784e158a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:14Z,use_quota=True,user_id='380d7cd8d5cc4a1fbab1306ed15d35e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Creating volume 78de8a47-63b0-4537-bcff-125f2c44b006 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:19:13 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:19:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:13 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 1073741824 Sep 02 16:19:13 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:14 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 1073741824" returned: 0 in 0.934s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:14 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 Sep 02 16:19:14 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:15 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006" returned: 0 in 0.608s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24044272-cd26-4f3d-aa02-ba3a8dad4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78de8a47-63b0-4537-bcff-125f2c44b006', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40e6fc7-4fff-454a-abf9-e0ced2ddaf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Volume volume-78de8a47-63b0-4537-bcff-125f2c44b006 (78de8a47-63b0-4537-bcff-125f2c44b006): created successfully Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40e6fc7-4fff-454a-abf9-e0ced2ddaf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Flow 'volume_create_manager' (694620a2-c2d8-4eee-aaba-adad89c51a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-23e3ed32-c0e7-41af-99ab-5231c0dd04f8 tempest-ServerRescueNegativeTestJSON-1981370075 None] Created volume successfully. Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "cinder-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "cinder-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "cinder-quobyte-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "cinder-quobyte-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec04b9-ae63-4c4b-9a3c-eb41139b117c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:19:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:18 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c Sep 02 16:19:18 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:19 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" returned: 0 in 0.822s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:19 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c Sep 02 16:19:19 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:19 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" returned: 0 in 0.468s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "cinder-quobyte-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c" released by "delete_volume" :: held 1.389s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:19:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Created reservations ['2e47c325-fa31-4d34-915e-aa59e41743a0', 'fb1f6d83-27fd-4190-8c68-34dfb974b242', '4ef47d96-f6e6-4865-9c3f-502dbe7066da', '61ab47e4-8777-4f62-bad7-72bfc0641d5c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:20 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:19:20 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:20 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.543s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:19:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Deleted volume successfully. Sep 02 16:19:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d50ce432-cd96-4f92-942d-65345e04fd04 tempest-TaggedAttachmentsTest-2046738692 None] Lock "cinder-5f3cadb2-aef1-4819-ab7f-c5c5bad5060c-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Flow 'volume_create_manager' (054adad9-669b-4290-b3b1-629afce26909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145297f7-9eea-4a54-acfa-bb87b1834a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145297f7-9eea-4a54-acfa-bb87b1834a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-149132374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c22ed-57b1-449b-844f-de5d93f63ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8ffc826e3540e9a1d8c96a315201c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:26Z,use_quota=True,user_id='68f9ca07131c40c8b8cbccd3214097aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e590c9-5a1d-4f40-80b7-6e229617a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e590c9-5a1d-4f40-80b7-6e229617a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4486f15b-c3cc-45c0-be19-8da2b9d088f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4486f15b-c3cc-45c0-be19-8da2b9d088f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409c22ed-57b1-449b-844f-de5d93f63ec4', 'volume_name': 'volume-409c22ed-57b1-449b-844f-de5d93f63ec4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ac867b-f048-4dcf-beea-b69c3f9f230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ac867b-f048-4dcf-beea-b69c3f9f230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0023e1f-f44d-4649-b0da-2cd302b2e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:25 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Volume 409c22ed-57b1-449b-844f-de5d93f63ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409c22ed-57b1-449b-844f-de5d93f63ec4', 'volume_size': 1} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-149132374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c22ed-57b1-449b-844f-de5d93f63ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8ffc826e3540e9a1d8c96a315201c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:26Z,use_quota=True,user_id='68f9ca07131c40c8b8cbccd3214097aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Creating volume 409c22ed-57b1-449b-844f-de5d93f63ec4 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:19:25 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:19:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:26 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 1073741824 Sep 02 16:19:26 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:26 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 1073741824" returned: 0 in 1.062s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:27 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 Sep 02 16:19:27 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:27 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4" returned: 0 in 0.465s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0023e1f-f44d-4649-b0da-2cd302b2e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409c22ed-57b1-449b-844f-de5d93f63ec4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182f6362-284f-46f5-8a78-ce90408e5efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:27 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Volume volume-409c22ed-57b1-449b-844f-de5d93f63ec4 (409c22ed-57b1-449b-844f-de5d93f63ec4): created successfully Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182f6362-284f-46f5-8a78-ce90408e5efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Flow 'volume_create_manager' (054adad9-669b-4290-b3b1-629afce26909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-11cc2881-53a6-449a-b814-8929c577d489 tempest-ServerActionsTestOtherA-987948759 None] Created volume successfully. Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Acquiring lock "cinder-78de8a47-63b0-4537-bcff-125f2c44b006-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "cinder-78de8a47-63b0-4537-bcff-125f2c44b006-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Acquiring lock "cinder-quobyte-78de8a47-63b0-4537-bcff-125f2c44b006" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "cinder-quobyte-78de8a47-63b0-4537-bcff-125f2c44b006" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4bef9-f7e8-4908-a23c-e47cd9eb5244]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:19:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:36 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 Sep 02 16:19:36 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:36 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006" returned: 0 in 0.931s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:36 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006 Sep 02 16:19:36 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:37 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78de8a47-63b0-4537-bcff-125f2c44b006" returned: 0 in 0.575s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "cinder-quobyte-78de8a47-63b0-4537-bcff-125f2c44b006" released by "delete_volume" :: held 1.651s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Created reservations ['49640545-3eb5-46f8-abb3-dac5827f70d5', '2e875f61-58da-4462-b028-dcce89952b4f', '2032dc2a-776d-4a7f-be22-08fdcbb8f18c', '2d3fa4cd-a359-4f54-8a10-5ea57d28aed7'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:37 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:19:37 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:38 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:38 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:19:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Deleted volume successfully. Sep 02 16:19:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e9e85cde-7773-4db9-9b24-c5427d715f56 tempest-ServerRescueNegativeTestJSON-1981370075 None] Lock "cinder-78de8a47-63b0-4537-bcff-125f2c44b006-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:19:47 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:INSERT=6 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:48 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:19:48 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:49 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:19:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:19:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 8 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:19:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Flow 'volume_create_manager' (6f9aa566-7318-488e-a1d6-c7bf394b853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21ff78-2d91-4356-b679-114334bc6bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21ff78-2d91-4356-b679-114334bc6bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-902183877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a98ff5-2409-4b78-a835-f064fad43bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e94ffb5d5ce44dcaa743d08e8fd5447e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:56Z,use_quota=True,user_id='f560163568c14927b28eed5752ee61bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d2ee61-50d2-4351-b1ba-0798bfd8ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d2ee61-50d2-4351-b1ba-0798bfd8ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feec9146-3cd6-49e0-80ed-64ea92ebaccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feec9146-3cd6-49e0-80ed-64ea92ebaccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a98ff5-2409-4b78-a835-f064fad43bf6', 'volume_name': 'volume-78a98ff5-2409-4b78-a835-f064fad43bf6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63253929-0afb-480c-a8a6-4e52c0badfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63253929-0afb-480c-a8a6-4e52c0badfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceeff1b-67af-4629-97d0-6248892d2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Volume 78a98ff5-2409-4b78-a835-f064fad43bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a98ff5-2409-4b78-a835-f064fad43bf6', 'volume_size': 1} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-902183877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a98ff5-2409-4b78-a835-f064fad43bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e94ffb5d5ce44dcaa743d08e8fd5447e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:19:56Z,use_quota=True,user_id='f560163568c14927b28eed5752ee61bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Creating volume 78a98ff5-2409-4b78-a835-f064fad43bf6 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:19:55 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:19:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:56 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 1073741824 Sep 02 16:19:56 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:56 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 1073741824" returned: 0 in 0.684s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:19:56 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 Sep 02 16:19:56 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:19:57 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6" returned: 0 in 0.450s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceeff1b-67af-4629-97d0-6248892d2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a98ff5-2409-4b78-a835-f064fad43bf6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d1e3e3-1986-410e-9212-6124d074331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:19:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Volume volume-78a98ff5-2409-4b78-a835-f064fad43bf6 (78a98ff5-2409-4b78-a835-f064fad43bf6): created successfully Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d1e3e3-1986-410e-9212-6124d074331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:19:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Flow 'volume_create_manager' (6f9aa566-7318-488e-a1d6-c7bf394b853a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:19:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c86f3036-9e03-4586-8c1c-3add70d930e0 tempest-AttachVolumeShelveTestJSON-911674187 None] Created volume successfully. Sep 02 16:20:07 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:07 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-764e85ae-1b01-4dab-9641-ec065e4680c9 req-e8af1c38-ac41-4be8-97fe-9043685ce558 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-764e85ae-1b01-4dab-9641-ec065e4680c9 req-e8af1c38-ac41-4be8-97fe-9043685ce558 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-764e85ae-1b01-4dab-9641-ec065e4680c9 req-e8af1c38-ac41-4be8-97fe-9043685ce558 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-764e85ae-1b01-4dab-9641-ec065e4680c9 req-e8af1c38-ac41-4be8-97fe-9043685ce558 tempest-ServerActionsTestOtherA-987948759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-409c22ed-57b1-449b-844f-de5d93f63ec4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0506580-aba6-4988-9148-5337d3b44a19', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:20:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-764e85ae-1b01-4dab-9641-ec065e4680c9 req-e8af1c38-ac41-4be8-97fe-9043685ce558 tempest-ServerActionsTestOtherA-987948759 None] attachment_update completed successfully. Sep 02 16:20:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-59437f37-de16-43ed-bf85-08b211d89aeb req-788390d6-33f9-4295-90ed-2a3d20f03d8f tempest-AttachVolumeShelveTestJSON-911674187 None] No connector for attachment a0643c6c-cca3-4bf3-a075-14648ec6f97a; skipping storage backend terminate_connection call. {{(pid=87051) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 02 16:20:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-59437f37-de16-43ed-bf85-08b211d89aeb req-788390d6-33f9-4295-90ed-2a3d20f03d8f tempest-AttachVolumeShelveTestJSON-911674187 None] Deleting attachment a0643c6c-cca3-4bf3-a075-14648ec6f97a. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:20:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-8b99c767-ea82-401d-9fa6-f1cc00ae3834 tempest-ServerActionsTestOtherA-987948759 None] Terminate volume connection completed successfully. Sep 02 16:20:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-8b99c767-ea82-401d-9fa6-f1cc00ae3834 tempest-ServerActionsTestOtherA-987948759 None] Deleting attachment f0506580-aba6-4988-9148-5337d3b44a19. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:20:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-360bc544-0f5f-43e9-9223-41f892d33fce tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-360bc544-0f5f-43e9-9223-41f892d33fce tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-360bc544-0f5f-43e9-9223-41f892d33fce tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-360bc544-0f5f-43e9-9223-41f892d33fce tempest-ServerActionsTestOtherA-987948759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-409c22ed-57b1-449b-844f-de5d93f63ec4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4563296f-8aed-458e-93b3-240e6903dec6', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:20:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-379b2314-e71e-4722-8bfe-a9fdd39973be req-360bc544-0f5f-43e9-9223-41f892d33fce tempest-ServerActionsTestOtherA-987948759 None] attachment_update completed successfully. Sep 02 16:20:34 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:34 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Flow 'volume_create_manager' (78e67efa-18e4-4fd8-a8ad-9e2a66e3fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971434dd-81a3-4f34-b9cc-fe238c74feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971434dd-81a3-4f34-b9cc-fe238c74feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1040397117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b128b34b-a297-4d88-a5eb-879bd2ff231a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1198be83f3148debf8250a29509007b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:20:35Z,use_quota=True,user_id='ac6e67e3362c405aa8af442b3ad6ac6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6789a3-2280-4dfd-a421-4084e6ee0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6789a3-2280-4dfd-a421-4084e6ee0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279ca262-5758-4473-9c10-55d3be6573d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279ca262-5758-4473-9c10-55d3be6573d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b128b34b-a297-4d88-a5eb-879bd2ff231a', 'volume_name': 'volume-b128b34b-a297-4d88-a5eb-879bd2ff231a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4cca2e-0536-438a-a948-1299de168f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4cca2e-0536-438a-a948-1299de168f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbafc34d-cd4f-46e0-8c29-e310473a7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:35 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Volume b128b34b-a297-4d88-a5eb-879bd2ff231a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b128b34b-a297-4d88-a5eb-879bd2ff231a', 'volume_size': 1} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1040397117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b128b34b-a297-4d88-a5eb-879bd2ff231a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1198be83f3148debf8250a29509007b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:20:35Z,use_quota=True,user_id='ac6e67e3362c405aa8af442b3ad6ac6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Creating volume b128b34b-a297-4d88-a5eb-879bd2ff231a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:20:35 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:35 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a 1073741824 Sep 02 16:20:35 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:35 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a 1073741824" returned: 0 in 0.575s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:35 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a Sep 02 16:20:35 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:36 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbafc34d-cd4f-46e0-8c29-e310473a7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b128b34b-a297-4d88-a5eb-879bd2ff231a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e56d60e-7450-4d57-b98c-1076faf15324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:36 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Volume volume-b128b34b-a297-4d88-a5eb-879bd2ff231a (b128b34b-a297-4d88-a5eb-879bd2ff231a): created successfully Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e56d60e-7450-4d57-b98c-1076faf15324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Flow 'volume_create_manager' (78e67efa-18e4-4fd8-a8ad-9e2a66e3fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:20:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-299492d4-45d5-4099-9a70-da9e714cb481 tempest-ServersNegativeTestJSON-333973748 None] Created volume successfully. Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Flow 'volume_create_manager' (742c0602-1d78-4509-b826-29bf17264574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6029549e-86af-4726-aefb-4f0727bf7942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6029549e-86af-4726-aefb-4f0727bf7942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067109950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ab661-b062-4565-b05b-3a672037cb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1198be83f3148debf8250a29509007b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:20:41Z,use_quota=True,user_id='ac6e67e3362c405aa8af442b3ad6ac6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69772b24-6197-4c9d-a413-88fe2cec3b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69772b24-6197-4c9d-a413-88fe2cec3b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7731996f-9731-440c-8932-a7e7fb306cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7731996f-9731-440c-8932-a7e7fb306cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8ab661-b062-4565-b05b-3a672037cb4c', 'volume_name': 'volume-5b8ab661-b062-4565-b05b-3a672037cb4c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847716ef-425b-416c-89e1-b63d6a3d629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847716ef-425b-416c-89e1-b63d6a3d629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f619abe-1f8d-492e-a257-d46dd9d440a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:40 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Volume 5b8ab661-b062-4565-b05b-3a672037cb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8ab661-b062-4565-b05b-3a672037cb4c', 'volume_size': 1} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067109950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ab661-b062-4565-b05b-3a672037cb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1198be83f3148debf8250a29509007b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:20:41Z,use_quota=True,user_id='ac6e67e3362c405aa8af442b3ad6ac6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Creating volume 5b8ab661-b062-4565-b05b-3a672037cb4c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:20:40 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:20:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:40 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c 1073741824 Sep 02 16:20:40 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:41 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c 1073741824" returned: 0 in 0.990s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:41 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c Sep 02 16:20:41 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:42 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c" returned: 0 in 0.433s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f619abe-1f8d-492e-a257-d46dd9d440a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8ab661-b062-4565-b05b-3a672037cb4c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c27b1a-8f33-46ec-b73f-91a9ce2dcadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:20:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Volume volume-5b8ab661-b062-4565-b05b-3a672037cb4c (5b8ab661-b062-4565-b05b-3a672037cb4c): created successfully Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c27b1a-8f33-46ec-b73f-91a9ce2dcadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:20:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Flow 'volume_create_manager' (742c0602-1d78-4509-b826-29bf17264574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:20:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-868b2fcb-6c54-428d-9a08-91352ad11a89 tempest-ServersNegativeTestJSON-333973748 None] Created volume successfully. Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "cinder-5b8ab661-b062-4565-b05b-3a672037cb4c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-5b8ab661-b062-4565-b05b-3a672037cb4c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "cinder-quobyte-5b8ab661-b062-4565-b05b-3a672037cb4c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-quobyte-5b8ab661-b062-4565-b05b-3a672037cb4c" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3606000-263a-4854-a0d9-00cb2ac4e5f4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:43 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c Sep 02 16:20:43 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:43 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c" returned: 0 in 0.404s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:43 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c Sep 02 16:20:43 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:44 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b8ab661-b062-4565-b05b-3a672037cb4c" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-quobyte-5b8ab661-b062-4565-b05b-3a672037cb4c" released by "delete_volume" :: held 0.779s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Created reservations ['d50ed59c-209f-4ecb-9d70-c303fd775a25', '1fa15647-1e05-44cf-884f-06e9aee41b21', '27f827eb-e489-497c-9caf-f6636fac86f9', '533492fc-eddd-4271-bd68-4c31c4d2b010'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:44 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:20:44 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "cinder-b128b34b-a297-4d88-a5eb-879bd2ff231a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-b128b34b-a297-4d88-a5eb-879bd2ff231a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "cinder-quobyte-b128b34b-a297-4d88-a5eb-879bd2ff231a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-quobyte-b128b34b-a297-4d88-a5eb-879bd2ff231a" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:20:44 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.353s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:20:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Deleted volume successfully. Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f5cfc-29be-4ab6-8215-26ad4d7d6642]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-99d602a9-0316-40a4-a8b4-1f1be148afd4 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-5b8ab661-b062-4565-b05b-3a672037cb4c-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:20:44 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a Sep 02 16:20:44 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:45 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a" returned: 0 in 0.505s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:45 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a Sep 02 16:20:45 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:45 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b128b34b-a297-4d88-a5eb-879bd2ff231a" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-quobyte-b128b34b-a297-4d88-a5eb-879bd2ff231a" released by "delete_volume" :: held 0.894s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Created reservations ['c67969f5-f167-497c-9102-a7c40564b375', '754a4d3e-3926-495a-8413-4406333f4096', 'ed08685e-4e6f-47fc-b40f-d99635addf33', '59771f48-f2c3-41a8-958d-74b1b9338921'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:45 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:20:45 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:46 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:46 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:20:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Deleted volume successfully. Sep 02 16:20:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-444f329f-5c9e-474b-a396-1d9f2519f7a6 tempest-ServersNegativeTestJSON-333973748 None] Lock "cinder-b128b34b-a297-4d88-a5eb-879bd2ff231a-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:20:48 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:20:48 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:20:48 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.384s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:20:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:20:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:20:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 8 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:20:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:20:55 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=24,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:56 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:20:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec9b01ee-977c-4d9d-b57b-468fab7c25f4 tempest-BackendsCapabilitiesAdminTestsJSON-33468863 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7958145141602, 'free_capacity_gb': 1773.7958145141602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87051) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 16:20:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fef3ec20-315e-4b5d-886b-86b0a5f79ed7 tempest-BackendsCapabilitiesAdminTestsJSON-33468863 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7958145141602, 'free_capacity_gb': 1773.7958145141602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87051) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (9e9f2c91-3bbd-470c-9f7c-9860f9159fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3fb541-0cf3-4055-9a2d-2988369cbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3fb541-0cf3-4055-9a2d-2988369cbc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-53897990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b12352c-6ea7-45dd-a587-aade63a3d8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:05Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bef81d7-44a4-413f-b1c5-74177c1d6786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bef81d7-44a4-413f-b1c5-74177c1d6786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e031c-c878-4fa5-b8fa-6934f9a4422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e031c-c878-4fa5-b8fa-6934f9a4422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b12352c-6ea7-45dd-a587-aade63a3d8cd', 'volume_name': 'volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33896ad-ab41-472f-8036-178213b2fa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33896ad-ab41-472f-8036-178213b2fa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b287fcca-9587-4067-bb20-c35053514d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Volume 7b12352c-6ea7-45dd-a587-aade63a3d8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd', 'volume_size': 1} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-53897990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b12352c-6ea7-45dd-a587-aade63a3d8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:05Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Creating volume 7b12352c-6ea7-45dd-a587-aade63a3d8cd {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:04 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:04 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd 1073741824 Sep 02 16:21:04 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:05 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd 1073741824" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:05 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd Sep 02 16:21:05 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:05 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b287fcca-9587-4067-bb20-c35053514d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2012daf5-b92f-4b63-b437-43b1e2d57032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Volume volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd (7b12352c-6ea7-45dd-a587-aade63a3d8cd): created successfully Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2012daf5-b92f-4b63-b437-43b1e2d57032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (9e9f2c91-3bbd-470c-9f7c-9860f9159fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f5476d9b-5beb-4386-9ded-79d7c1881926 tempest-AttachVolumeTestJSON-1412095487 None] Created volume successfully. Sep 02 16:21:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-d7113d96-07dc-4765-99d6-fd47c637da45 req-8c914e4b-aec7-40cc-b9ce-c82ab24b5ac5 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-d7113d96-07dc-4765-99d6-fd47c637da45 req-8c914e4b-aec7-40cc-b9ce-c82ab24b5ac5 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-d7113d96-07dc-4765-99d6-fd47c637da45 req-8c914e4b-aec7-40cc-b9ce-c82ab24b5ac5 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-d7113d96-07dc-4765-99d6-fd47c637da45 req-8c914e4b-aec7-40cc-b9ce-c82ab24b5ac5 tempest-AttachVolumeTestJSON-1412095487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e953a22-23e4-4983-a9ea-1d4373e629ce', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:21:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-d7113d96-07dc-4765-99d6-fd47c637da45 req-8c914e4b-aec7-40cc-b9ce-c82ab24b5ac5 tempest-AttachVolumeTestJSON-1412095487 None] attachment_update completed successfully. Sep 02 16:21:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-9a116e37-f0ea-4918-8529-edf4d88972cb req-0e5d9ab2-9287-4efe-8ffe-9738002b4e63 tempest-ServerActionsTestOtherA-987948759 None] Terminate volume connection completed successfully. Sep 02 16:21:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-9a116e37-f0ea-4918-8529-edf4d88972cb req-0e5d9ab2-9287-4efe-8ffe-9738002b4e63 tempest-ServerActionsTestOtherA-987948759 None] Deleting attachment 4563296f-8aed-458e-93b3-240e6903dec6. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Flow 'volume_create_manager' (61755501-355f-4bdd-8412-923bbb5a093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e077c4-5df7-413e-9a37-8510cadee658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e077c4-5df7-413e-9a37-8510cadee658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-622986522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ad5672-4b08-4235-a6b8-cc573ab434a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f710f2ce72496181ada1a5c28b4a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:14Z,use_quota=True,user_id='44bcb983d8b742dba06c386c7b21aa6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d1a14f-0b5d-4702-822f-bb23773729b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d1a14f-0b5d-4702-822f-bb23773729b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e2ff8-b0e1-49e1-8ecf-7dd6afecf361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e2ff8-b0e1-49e1-8ecf-7dd6afecf361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ad5672-4b08-4235-a6b8-cc573ab434a1', 'volume_name': 'volume-57ad5672-4b08-4235-a6b8-cc573ab434a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fc2e49-8ad9-452b-be6c-8391e8351b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fc2e49-8ad9-452b-be6c-8391e8351b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6fb69-b371-4b8e-bdd0-9f29900ed228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Volume 57ad5672-4b08-4235-a6b8-cc573ab434a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ad5672-4b08-4235-a6b8-cc573ab434a1', 'volume_size': 1} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-622986522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ad5672-4b08-4235-a6b8-cc573ab434a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f710f2ce72496181ada1a5c28b4a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:14Z,use_quota=True,user_id='44bcb983d8b742dba06c386c7b21aa6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Creating volume 57ad5672-4b08-4235-a6b8-cc573ab434a1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:13 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:13 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 1073741824 Sep 02 16:21:13 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:14 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 1073741824" returned: 0 in 0.492s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:14 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 Sep 02 16:21:14 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:14 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1" returned: 0 in 0.313s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6fb69-b371-4b8e-bdd0-9f29900ed228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ad5672-4b08-4235-a6b8-cc573ab434a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96c599b-8062-4558-841c-37c2033f990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Volume volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 (57ad5672-4b08-4235-a6b8-cc573ab434a1): created successfully Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96c599b-8062-4558-841c-37c2033f990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Flow 'volume_create_manager' (61755501-355f-4bdd-8412-923bbb5a093b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1ff7292b-81e4-4dd8-b7cd-f19de10fca55 tempest-VolumesServicesTestJSON-944652562 None] Created volume successfully. Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Acquiring lock "cinder-57ad5672-4b08-4235-a6b8-cc573ab434a1-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "cinder-57ad5672-4b08-4235-a6b8-cc573ab434a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Acquiring lock "cinder-quobyte-57ad5672-4b08-4235-a6b8-cc573ab434a1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "cinder-quobyte-57ad5672-4b08-4235-a6b8-cc573ab434a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f84776-d979-4b35-b6ff-aa40c8bcc88a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:16 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 Sep 02 16:21:16 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:16 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:16 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1 Sep 02 16:21:16 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:16 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-57ad5672-4b08-4235-a6b8-cc573ab434a1" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "cinder-quobyte-57ad5672-4b08-4235-a6b8-cc573ab434a1" released by "delete_volume" :: held 0.689s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:16 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Created reservations ['3c7851fd-b4b9-434a-ba79-aa4cc23c108f', '05f02640-af7d-483e-a7f9-e52cfee8a243', 'b2f87202-7717-4c15-bf72-c5971049d024', 'd1d5eac4-b3ea-4ef6-a796-f891f703c1eb'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:17 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:17 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:17 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Deleted volume successfully. Sep 02 16:21:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-79f0593c-451a-4da1-91ec-3933c80a797b tempest-VolumesServicesTestJSON-944652562 None] Lock "cinder-57ad5672-4b08-4235-a6b8-cc573ab434a1-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Flow 'volume_create_manager' (b8b9f13b-183e-4bf4-9614-f74c115dff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cddd1bd-5441-49d2-8258-39c29fa41532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cddd1bd-5441-49d2-8258-39c29fa41532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-767080491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32741032-dd90-4026-8ae9-5a94880d9cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8ffc826e3540e9a1d8c96a315201c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:21Z,use_quota=True,user_id='68f9ca07131c40c8b8cbccd3214097aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ec148a-099e-45d4-94b2-ef1d9cb6a18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ec148a-099e-45d4-94b2-ef1d9cb6a18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f69059-a21f-4fae-9a06-c160fa74baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:21 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f69059-a21f-4fae-9a06-c160fa74baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32741032-dd90-4026-8ae9-5a94880d9cf1', 'volume_name': 'volume-32741032-dd90-4026-8ae9-5a94880d9cf1', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bce365d-44cf-42c4-b2c4-ca71e88d3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bce365d-44cf-42c4-b2c4-ca71e88d3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f14ee-3dfb-4676-9a8a-030e4900922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:22 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Volume 32741032-dd90-4026-8ae9-5a94880d9cf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32741032-dd90-4026-8ae9-5a94880d9cf1', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Trying to clone 32741032-dd90-4026-8ae9-5a94880d9cf1 from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:21:22 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Image download 20.69 MB at 20.69 MB/s Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[270fff11-99bc-47f3-82b5-5b84ebf827b6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:22 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD Sep 02 16:21:22 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:23 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd is fetched for user 68f9ca07131c40c8b8cbccd3214097aa. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f915bf-cfce-4299-bc36-4e15cba06d24]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:23 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD Sep 02 16:21:23 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Acquiring lock "cinder-78a98ff5-2409-4b78-a835-f064fad43bf6-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "cinder-78a98ff5-2409-4b78-a835-f064fad43bf6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Acquiring lock "cinder-quobyte-78a98ff5-2409-4b78-a835-f064fad43bf6" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "cinder-quobyte-78a98ff5-2409-4b78-a835-f064fad43bf6" acquired by "delete_volume" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a197e34-2944-4f62-ac3a-592d4c0fc95d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:23 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-767080491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32741032-dd90-4026-8ae9-5a94880d9cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8ffc826e3540e9a1d8c96a315201c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:21Z,use_quota=True,user_id='68f9ca07131c40c8b8cbccd3214097aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Creating volume 32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:23 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:23 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1073741824 Sep 02 16:21:23 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 Sep 02 16:21:23 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:23 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:23 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6" returned: 0 in 0.412s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:23 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6 Sep 02 16:21:23 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:24 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1073741824" returned: 0 in 0.503s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:24 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 Sep 02 16:21:24 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:24 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78a98ff5-2409-4b78-a835-f064fad43bf6" returned: 0 in 0.274s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "cinder-quobyte-78a98ff5-2409-4b78-a835-f064fad43bf6" released by "delete_volume" :: held 0.731s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Created reservations ['665d2de9-aae3-445d-b2c4-45154650b116', '743940fb-91a6-43b6-b2c2-2a57ad34579e', '7b188dc7-4990-44eb-80f2-ace20785a3a6', '451176dc-fa4f-4c04-9ff9-503d31526f41'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:24 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:24 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:24 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Attempting download of e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 32741032-dd90-4026-8ae9-5a94880d9cf1. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e8d913-91a1-4e99-9caa-312b0534a8ac]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:24 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.339s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:24 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp Sep 02 16:21:24 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Deleted volume successfully. Sep 02 16:21:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-489ea2ab-7186-4bc5-8445-729eb687b078 tempest-AttachVolumeShelveTestJSON-911674187 None] Lock "cinder-78a98ff5-2409-4b78-a835-f064fad43bf6-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:25 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp" returned: 0 in 0.423s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:25 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp Sep 02 16:21:25 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:25 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp" returned: 1 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_om8p05rp' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99313bd-5d43-4acd-9588-b9924795dea4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:25 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD Sep 02 16:21:25 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:25 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:21:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:25 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 Sep 02 16:21:25 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:27 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1" returned: 0 in 2.199s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:27 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_91q8w7trdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:21:27 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Converted 112.00 MB image at 50.91 MB/s Sep 02 16:21:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:27 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1G Sep 02 16:21:27 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:28 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 1G" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Downloaded image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 32741032-dd90-4026-8ae9-5a94880d9cf1 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd for user 68f9ca07131c40c8b8cbccd3214097aa is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Marking volume 32741032-dd90-4026-8ae9-5a94880d9cf1 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Copying metadata from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd to 32741032-dd90-4026-8ae9-5a94880d9cf1. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Creating volume glance metadata for volume 32741032-dd90-4026-8ae9-5a94880d9cf1 backed by image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f14ee-3dfb-4676-9a8a-030e4900922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32741032-dd90-4026-8ae9-5a94880d9cf1', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef886d8-4f29-474f-b14c-f972c3bcbbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:28 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Volume volume-32741032-dd90-4026-8ae9-5a94880d9cf1 (32741032-dd90-4026-8ae9-5a94880d9cf1): created successfully Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef886d8-4f29-474f-b14c-f972c3bcbbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Flow 'volume_create_manager' (b8b9f13b-183e-4bf4-9614-f74c115dff9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fa43af70-6fa3-4dd9-813d-7a13274525fd tempest-ServerActionsTestOtherA-987948759 None] Created volume successfully. Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Flow 'volume_create_manager' (19fa873d-443e-496e-a2a2-c08971946ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11681290-9938-4479-be4e-816cd5cbf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11681290-9938-4479-be4e-816cd5cbf761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1011227767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42902101-f972-4be3-be5b-0b91a37abad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf85b3727234a9292799bd3ee577b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:31Z,use_quota=True,user_id='b3c5fa89645d4f8f8d46572bcbb587b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2a8f0e-d39d-4d37-8a1c-057c3b0e3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2a8f0e-d39d-4d37-8a1c-057c3b0e3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0de30f-8448-419f-bcb4-6e5a44c94f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0de30f-8448-419f-bcb4-6e5a44c94f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42902101-f972-4be3-be5b-0b91a37abad7', 'volume_name': 'volume-42902101-f972-4be3-be5b-0b91a37abad7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf56058-1a64-487e-b007-bb3266220aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf56058-1a64-487e-b007-bb3266220aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8bfdf2-bf22-4577-bbc0-d8d20775bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Volume 42902101-f972-4be3-be5b-0b91a37abad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42902101-f972-4be3-be5b-0b91a37abad7', 'volume_size': 1} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1011227767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42902101-f972-4be3-be5b-0b91a37abad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf85b3727234a9292799bd3ee577b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:31Z,use_quota=True,user_id='b3c5fa89645d4f8f8d46572bcbb587b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Creating volume 42902101-f972-4be3-be5b-0b91a37abad7 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:30 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:30 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 1073741824 Sep 02 16:21:30 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:31 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 1073741824" returned: 0 in 0.643s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:31 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 Sep 02 16:21:31 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:31 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7" returned: 0 in 0.324s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8bfdf2-bf22-4577-bbc0-d8d20775bc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42902101-f972-4be3-be5b-0b91a37abad7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f1871-7540-4618-b0ba-b4741cd7ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Volume volume-42902101-f972-4be3-be5b-0b91a37abad7 (42902101-f972-4be3-be5b-0b91a37abad7): created successfully Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f1871-7540-4618-b0ba-b4741cd7ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Flow 'volume_create_manager' (19fa873d-443e-496e-a2a2-c08971946ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8068aa94-5843-4630-8305-3317c9620c41 tempest-AbsoluteLimitsTests-761601523 None] Created volume successfully. Sep 02 16:21:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-70b5d490-0869-4c4c-8e37-af71bb6ca1e6 req-eb0cb2d6-f8d9-4fb1-b36f-9e3ace119cbb tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-70b5d490-0869-4c4c-8e37-af71bb6ca1e6 req-eb0cb2d6-f8d9-4fb1-b36f-9e3ace119cbb tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-70b5d490-0869-4c4c-8e37-af71bb6ca1e6 req-eb0cb2d6-f8d9-4fb1-b36f-9e3ace119cbb tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-70b5d490-0869-4c4c-8e37-af71bb6ca1e6 req-eb0cb2d6-f8d9-4fb1-b36f-9e3ace119cbb tempest-ServerActionsTestOtherA-987948759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-32741032-dd90-4026-8ae9-5a94880d9cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fdfff72-ffc4-4ea6-b90f-91f57e0515a4', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:21:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-70b5d490-0869-4c4c-8e37-af71bb6ca1e6 req-eb0cb2d6-f8d9-4fb1-b36f-9e3ace119cbb tempest-ServerActionsTestOtherA-987948759 None] attachment_update completed successfully. Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Acquiring lock "cinder-42902101-f972-4be3-be5b-0b91a37abad7-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "cinder-42902101-f972-4be3-be5b-0b91a37abad7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Acquiring lock "cinder-quobyte-42902101-f972-4be3-be5b-0b91a37abad7" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "cinder-quobyte-42902101-f972-4be3-be5b-0b91a37abad7" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f61446d-0701-4b51-942d-e0a934b20e5a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:33 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 Sep 02 16:21:33 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:33 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7" returned: 0 in 0.396s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:33 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7 Sep 02 16:21:33 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:33 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-42902101-f972-4be3-be5b-0b91a37abad7" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "cinder-quobyte-42902101-f972-4be3-be5b-0b91a37abad7" released by "delete_volume" :: held 0.756s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Created reservations ['a18562c6-d062-4529-8f4d-5972dc961519', '27bf7442-73ba-4ed8-a9c9-708b03eebbf9', '36d0d278-6961-454b-8fdd-e39da251a3cb', 'a7c090c5-7792-45a6-8b13-e8b830ea624f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:34 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:34 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:34 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Deleted volume successfully. Sep 02 16:21:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1132faeb-3c0e-4fdb-a308-4d8f55db1289 tempest-AbsoluteLimitsTests-761601523 None] Lock "cinder-42902101-f972-4be3-be5b-0b91a37abad7-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Flow 'volume_create_manager' (a0118aa3-37cb-4dd1-bdef-eacf1c305485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bddb46-f1e6-4e0f-b543-74a666b99320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bddb46-f1e6-4e0f-b543-74a666b99320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-258364624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98e59fd-945c-4d3c-b900-bea8fd3322c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044f4f4c4944d2087641f70bcbb460b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:44Z,use_quota=True,user_id='c040b5689aef49729d49e07d17f0f611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ab338c-3dc0-45aa-bf71-a5734d9ccb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ab338c-3dc0-45aa-bf71-a5734d9ccb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b18bcba-ab49-4923-81a6-070b93141677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b18bcba-ab49-4923-81a6-070b93141677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98e59fd-945c-4d3c-b900-bea8fd3322c5', 'volume_name': 'volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec9085a-ae4e-44f0-89c7-c90b0cdabbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec9085a-ae4e-44f0-89c7-c90b0cdabbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940143b-83f9-4d8b-82ba-0baf153fa684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:44 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Volume d98e59fd-945c-4d3c-b900-bea8fd3322c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5', 'volume_size': 1} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-258364624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98e59fd-945c-4d3c-b900-bea8fd3322c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044f4f4c4944d2087641f70bcbb460b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:44Z,use_quota=True,user_id='c040b5689aef49729d49e07d17f0f611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Creating volume d98e59fd-945c-4d3c-b900-bea8fd3322c5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:44 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:44 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 1073741824 Sep 02 16:21:44 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:45 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 1073741824" returned: 0 in 0.917s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:45 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 Sep 02 16:21:45 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:45 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5" returned: 0 in 0.359s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940143b-83f9-4d8b-82ba-0baf153fa684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea466ab-c79d-4ff3-9c43-57da602f4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Volume volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 (d98e59fd-945c-4d3c-b900-bea8fd3322c5): created successfully Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea466ab-c79d-4ff3-9c43-57da602f4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Flow 'volume_create_manager' (a0118aa3-37cb-4dd1-bdef-eacf1c305485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:45 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6e9339fa-1918-4904-a037-d442394b240b tempest-VolumesTransfersV355Test-1778465595 None] Created volume successfully. Sep 02 16:21:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ebe0ada9-50f2-40bf-a107-3648b0397310 tempest-VolumesTransfersV355Test-1995533913 None] Transfer volume completed successfully. Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:48 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:48 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "cinder-d98e59fd-945c-4d3c-b900-bea8fd3322c5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-d98e59fd-945c-4d3c-b900-bea8fd3322c5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "cinder-quobyte-d98e59fd-945c-4d3c-b900-bea8fd3322c5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-quobyte-d98e59fd-945c-4d3c-b900-bea8fd3322c5" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f531ec4-804a-4a8f-928e-c309b310a382]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:49 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.682s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:49 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 Sep 02 16:21:49 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:21:49 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5" returned: 0 in 0.737s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:49 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5 Sep 02 16:21:49 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:50 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d98e59fd-945c-4d3c-b900-bea8fd3322c5" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-quobyte-d98e59fd-945c-4d3c-b900-bea8fd3322c5" released by "delete_volume" :: held 1.215s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Created reservations ['96416436-bc20-4b64-a6d5-21a340ce9cbf', '98a9a5cb-9d31-4509-bb3c-3ccd94e6f01c', '04d7c132-1acf-4d97-b654-1fe11a8c3be6', '1bbbf331-007a-4e21-a5af-7df67e8e0db9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:50 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:50 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:50 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Deleted volume successfully. Sep 02 16:21:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fa20a0ca-a7a9-4271-bdb5-cf1af6f33d62 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-d98e59fd-945c-4d3c-b900-bea8fd3322c5-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-35473165-f3fb-4756-8afd-cd1b7cbe1d74 tempest-ServerActionsTestOtherA-987948759 None] Terminate volume connection completed successfully. Sep 02 16:21:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-35473165-f3fb-4756-8afd-cd1b7cbe1d74 tempest-ServerActionsTestOtherA-987948759 None] Deleting attachment 7fdfff72-ffc4-4ea6-b90f-91f57e0515a4. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:21:51 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Flow 'volume_create_manager' (105ded68-0159-403f-9da5-2f1253f7ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02328bec-ac99-4a32-bcaf-e1dd67c61472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02328bec-ac99-4a32-bcaf-e1dd67c61472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-495118408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e59e8a-1fe6-4630-baf0-71aec0a36b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044f4f4c4944d2087641f70bcbb460b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:52Z,use_quota=True,user_id='c040b5689aef49729d49e07d17f0f611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d83a9f-60ce-445d-8f31-b4a6a14107f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d83a9f-60ce-445d-8f31-b4a6a14107f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ff4827-e361-4954-9aec-d6194f4661a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ff4827-e361-4954-9aec-d6194f4661a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e59e8a-1fe6-4630-baf0-71aec0a36b30', 'volume_name': 'volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea863f9-0b2f-4883-b1e3-e41b0cf996d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea863f9-0b2f-4883-b1e3-e41b0cf996d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7197c8a7-7148-45c3-a824-016c62d7d226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:52 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Volume c4e59e8a-1fe6-4630-baf0-71aec0a36b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30', 'volume_size': 1} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-495118408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e59e8a-1fe6-4630-baf0-71aec0a36b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044f4f4c4944d2087641f70bcbb460b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:21:52Z,use_quota=True,user_id='c040b5689aef49729d49e07d17f0f611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Creating volume c4e59e8a-1fe6-4630-baf0-71aec0a36b30 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:21:52 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:52 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 1073741824 Sep 02 16:21:52 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:52 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 1073741824" returned: 0 in 0.520s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:52 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 Sep 02 16:21:52 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:53 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" returned: 0 in 0.337s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7197c8a7-7148-45c3-a824-016c62d7d226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45846e09-5ea8-481d-98c8-fa9c97dede5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:21:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Volume volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 (c4e59e8a-1fe6-4630-baf0-71aec0a36b30): created successfully Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45846e09-5ea8-481d-98c8-fa9c97dede5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Flow 'volume_create_manager' (105ded68-0159-403f-9da5-2f1253f7ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:21:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4c60e254-0a12-4d54-b97d-be3951d8ac6f tempest-VolumesTransfersV355Test-1778465595 None] Created volume successfully. Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-970c4661-94d6-4375-9800-b7c1924b6d58 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-970c4661-94d6-4375-9800-b7c1924b6d58 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-970c4661-94d6-4375-9800-b7c1924b6d58 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-970c4661-94d6-4375-9800-b7c1924b6d58 tempest-ServerActionsTestOtherA-987948759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-32741032-dd90-4026-8ae9-5a94880d9cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '132f3554-7097-495b-a40a-e4b403638a40', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:21:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-6ac14c28-7244-4ce8-8d85-0e2b92f7d420 req-970c4661-94d6-4375-9800-b7c1924b6d58 tempest-ServerActionsTestOtherA-987948759 None] attachment_update completed successfully. Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "cinder-c4e59e8a-1fe6-4630-baf0-71aec0a36b30-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-c4e59e8a-1fe6-4630-baf0-71aec0a36b30-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "cinder-quobyte-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-quobyte-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ecb3a-9adc-4b02-84f6-903bf9b018d8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:21:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:54 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 Sep 02 16:21:54 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:55 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" returned: 0 in 0.597s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:55 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30 Sep 02 16:21:55 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:55 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" returned: 0 in 0.309s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-quobyte-c4e59e8a-1fe6-4630-baf0-71aec0a36b30" released by "delete_volume" :: held 0.954s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=65,cinder:UPDATE=62,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Created reservations ['a4ad755b-f9df-4838-9167-03ad995d1f99', '1adcdc3d-de36-4f57-9682-c9636d7fd649', 'b2b736ed-e1b3-4dee-8a6a-bdd408829609', '8d234d80-ef26-46e9-a6d7-fb379b20fcf8'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:21:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:21:55 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:21:55 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:21:56 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 02 16:21:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.490s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:21:56 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:21:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Deleted volume successfully. Sep 02 16:21:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-809e0e76-245f-4222-8c3a-c999f19dbb40 tempest-VolumesTransfersV355Test-1674604178 None] Lock "cinder-c4e59e8a-1fe6-4630-baf0-71aec0a36b30-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:05 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=60,cinder:SELECT=66,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:22:06 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Flow 'volume_create_manager' (84cf9ca9-3f63-4211-838d-2e36a62be70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8e54dd-ebbb-4553-a555-0af80647ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8e54dd-ebbb-4553-a555-0af80647ddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807701888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02695100-40e1-4737-8f96-2b0189b0a3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4082be9803247ebbade4fb5251d8aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:22:19Z,use_quota=True,user_id='f8768583f4b54603b82f820389d54215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e885b52a-4274-41fa-9935-af994abffea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e885b52a-4274-41fa-9935-af994abffea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2f45d1-110c-446f-bbcf-1ea9a5e7b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2f45d1-110c-446f-bbcf-1ea9a5e7b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02695100-40e1-4737-8f96-2b0189b0a3ca', 'volume_name': 'volume-02695100-40e1-4737-8f96-2b0189b0a3ca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a07a96c-eaec-4cde-b471-445ac6902b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a07a96c-eaec-4cde-b471-445ac6902b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d26aeb6-5278-4feb-99b1-c1848745b5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:19 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Volume 02695100-40e1-4737-8f96-2b0189b0a3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02695100-40e1-4737-8f96-2b0189b0a3ca', 'volume_size': 1} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807701888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02695100-40e1-4737-8f96-2b0189b0a3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4082be9803247ebbade4fb5251d8aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:22:19Z,use_quota=True,user_id='f8768583f4b54603b82f820389d54215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Creating volume 02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:22:19 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:19 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca 1073741824 Sep 02 16:22:19 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:19 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca 1073741824" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:20 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:22:20 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:20 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d26aeb6-5278-4feb-99b1-c1848745b5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02695100-40e1-4737-8f96-2b0189b0a3ca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfda732-a533-42d1-8394-77c350efc529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:20 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Volume volume-02695100-40e1-4737-8f96-2b0189b0a3ca (02695100-40e1-4737-8f96-2b0189b0a3ca): created successfully Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfda732-a533-42d1-8394-77c350efc529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Flow 'volume_create_manager' (84cf9ca9-3f63-4211-838d-2e36a62be70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:22:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-70feda96-5ff2-401f-b7f6-edcc34b072c4 tempest-VolumesActionsTest-1695936643 None] Created volume successfully. Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fd61f5e3-8728-4b4c-a767-65f6619e8c3e tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" by "attach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fd61f5e3-8728-4b4c-a767-65f6619e8c3e tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" acquired by "attach_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fd61f5e3-8728-4b4c-a767-65f6619e8c3e tempest-VolumesActionsTest-1695936643 None] Attaching volume 02695100-40e1-4737-8f96-2b0189b0a3ca to instance f56e7341-65ee-46de-98eb-2e0686196b1e at mountpoint /dev/vdb on host None. Sep 02 16:22:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fd61f5e3-8728-4b4c-a767-65f6619e8c3e tempest-VolumesActionsTest-1695936643 None] Attach volume completed successfully. Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fd61f5e3-8728-4b4c-a767-65f6619e8c3e tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" released by "attach_volume" :: held 0.164s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5c1ac5cd-0b6d-40be-ba0b-48a0af9ccec4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" by "detach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5c1ac5cd-0b6d-40be-ba0b-48a0af9ccec4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5c1ac5cd-0b6d-40be-ba0b-48a0af9ccec4 tempest-VolumesActionsTest-1695936643 None] Detaching volume 02695100-40e1-4737-8f96-2b0189b0a3ca from instance f56e7341-65ee-46de-98eb-2e0686196b1e. Sep 02 16:22:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5c1ac5cd-0b6d-40be-ba0b-48a0af9ccec4 tempest-VolumesActionsTest-1695936643 None] Detach volume completed successfully. Sep 02 16:22:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5c1ac5cd-0b6d-40be-ba0b-48a0af9ccec4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-fd77bab0-b3fb-45fc-92df-14018f706e4b tempest-ServerActionsTestOtherA-987948759 None] Terminate volume connection completed successfully. Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-fd77bab0-b3fb-45fc-92df-14018f706e4b tempest-ServerActionsTestOtherA-987948759 None] Deleting attachment 132f3554-7097-495b-a40a-e4b403638a40. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "cinder-32741032-dd90-4026-8ae9-5a94880d9cf1-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-32741032-dd90-4026-8ae9-5a94880d9cf1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "cinder-quobyte-32741032-dd90-4026-8ae9-5a94880d9cf1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-quobyte-32741032-dd90-4026-8ae9-5a94880d9cf1" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[51237f68-49ba-4b32-91de-2d6db43a8fd2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:22:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:29 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 Sep 02 16:22:29 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:30 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1" returned: 0 in 0.864s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:22:30 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1 Sep 02 16:22:30 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (b24c1928-ea92-482e-903a-166fa42a7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5b0774-d8e6-496c-b7bd-887cd58e0d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5b0774-d8e6-496c-b7bd-887cd58e0d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644625479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff36494-1afc-4c56-8193-1d86340d75e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:22:31Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a1c62-0a93-4215-a61d-558a399a05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a1c62-0a93-4215-a61d-558a399a05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c381d9-1ac6-490f-ab72-5352a35a48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c381d9-1ac6-490f-ab72-5352a35a48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff36494-1afc-4c56-8193-1d86340d75e8', 'volume_name': 'volume-eff36494-1afc-4c56-8193-1d86340d75e8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b264c4d6-91a2-46df-b8b4-1be538a3580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b264c4d6-91a2-46df-b8b4-1be538a3580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f168e3b-272b-4446-ae3c-b6538b02420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Volume eff36494-1afc-4c56-8193-1d86340d75e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff36494-1afc-4c56-8193-1d86340d75e8', 'volume_size': 1} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644625479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff36494-1afc-4c56-8193-1d86340d75e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:22:31Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Creating volume eff36494-1afc-4c56-8193-1d86340d75e8 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:22:30 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:30 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 1073741824 Sep 02 16:22:30 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:30 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-32741032-dd90-4026-8ae9-5a94880d9cf1" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-quobyte-32741032-dd90-4026-8ae9-5a94880d9cf1" released by "delete_volume" :: held 1.274s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.quota [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Created reservations ['1dbf9b1f-cab4-4e4e-9339-43b7391d78c1', 'db26d5b3-8c49-4eb0-88fa-3d93db507175', 'b11c9248-de1a-41f7-b827-643eb3c4881c', '36a58635-d685-4d99-8fb2-d72804ead205'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:31 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:22:31 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:31 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 1073741824" returned: 0 in 0.735s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:31 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 Sep 02 16:22:31 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:31 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.manager [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:22:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Deleted volume successfully. Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-336303e3-bc32-4c29-80d8-342a1779ca5c req-0710bee3-2645-454b-8479-53e28349c775 tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-32741032-dd90-4026-8ae9-5a94880d9cf1-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "cinder-409c22ed-57b1-449b-844f-de5d93f63ec4-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-409c22ed-57b1-449b-844f-de5d93f63ec4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "cinder-quobyte-409c22ed-57b1-449b-844f-de5d93f63ec4" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-quobyte-409c22ed-57b1-449b-844f-de5d93f63ec4" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:31 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8" returned: 0 in 0.376s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4e8e4d-bbe9-4aa0-a166-3f5c26baffc0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f168e3b-272b-4446-ae3c-b6538b02420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff36494-1afc-4c56-8193-1d86340d75e8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4295412-a4d3-4990-94be-ed45cc3375c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:22:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Volume volume-eff36494-1afc-4c56-8193-1d86340d75e8 (eff36494-1afc-4c56-8193-1d86340d75e8): created successfully Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4295412-a4d3-4990-94be-ed45cc3375c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:22:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (b24c1928-ea92-482e-903a-166fa42a7a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:22:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0078efed-84f9-427d-93aa-7f00a6b5281d tempest-AttachVolumeNegativeTest-639539955 None] Created volume successfully. Sep 02 16:22:32 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 Sep 02 16:22:32 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:32 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4" returned: 0 in 0.466s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:32 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4 Sep 02 16:22:32 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:32 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-409c22ed-57b1-449b-844f-de5d93f63ec4" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-quobyte-409c22ed-57b1-449b-844f-de5d93f63ec4" released by "delete_volume" :: held 0.778s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Created reservations ['8a42e924-0771-4a81-b633-9d5eb4f17797', 'aacbc56b-5c13-41a1-967c-879fd2c1e6e3', 'a8bb7095-8501-4904-8d42-11a28e4f2cda', '07b595d7-33a2-4ee6-b091-9324b1c371f6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:32 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:22:32 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:33 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:22:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Deleted volume successfully. Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f9167cf6-8464-4bbc-afc8-8a74451d9d4f tempest-ServerActionsTestOtherA-987948759 None] Lock "cinder-409c22ed-57b1-449b-844f-de5d93f63ec4-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3acc1524-ea55-4379-8890-36c8fa4b81ae req-08ffee36-172f-4dd5-b00a-47c14fbd8e74 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3acc1524-ea55-4379-8890-36c8fa4b81ae req-08ffee36-172f-4dd5-b00a-47c14fbd8e74 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3acc1524-ea55-4379-8890-36c8fa4b81ae req-08ffee36-172f-4dd5-b00a-47c14fbd8e74 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-3acc1524-ea55-4379-8890-36c8fa4b81ae req-08ffee36-172f-4dd5-b00a-47c14fbd8e74 tempest-AttachVolumeNegativeTest-639539955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-eff36494-1afc-4c56-8193-1d86340d75e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee754cee-b7a2-458c-af9f-7001ee0aacdc', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:22:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-3acc1524-ea55-4379-8890-36c8fa4b81ae req-08ffee36-172f-4dd5-b00a-47c14fbd8e74 tempest-AttachVolumeNegativeTest-639539955 None] attachment_update completed successfully. Sep 02 16:22:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cc9462ad-64c5-4c69-b700-09e030be5545 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" by "attach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cc9462ad-64c5-4c69-b700-09e030be5545 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" acquired by "attach_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cc9462ad-64c5-4c69-b700-09e030be5545 tempest-VolumesActionsTest-1695936643 None] Attaching volume 02695100-40e1-4737-8f96-2b0189b0a3ca to instance 80060e7a-ac18-406a-8431-721c3213dd59 at mountpoint /dev/vdb on host None. Sep 02 16:22:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cc9462ad-64c5-4c69-b700-09e030be5545 tempest-VolumesActionsTest-1695936643 None] Attach volume completed successfully. Sep 02 16:22:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cc9462ad-64c5-4c69-b700-09e030be5545 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca" released by "attach_volume" :: held 0.127s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3a068dc2-2b76-4ece-9bb0-11c2275e6b04 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" by "detach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:22:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3a068dc2-2b76-4ece-9bb0-11c2275e6b04 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:22:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3a068dc2-2b76-4ece-9bb0-11c2275e6b04 tempest-VolumesActionsTest-1695936643 None] Detaching volume 02695100-40e1-4737-8f96-2b0189b0a3ca from instance 80060e7a-ac18-406a-8431-721c3213dd59. Sep 02 16:22:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3a068dc2-2b76-4ece-9bb0-11c2275e6b04 tempest-VolumesActionsTest-1695936643 None] Detach volume completed successfully. Sep 02 16:22:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3a068dc2-2b76-4ece-9bb0-11c2275e6b04 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:48 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:22:48 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:48 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.284s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:22:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ae58d-8895-4fe2-a7f8-e49509560b67]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:49 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:22:49 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:49 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d0a82-b5ca-49b8-882a-b9013e27f841]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:22:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:49 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:22:49 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:50 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.584s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.d94b10a7-8927-402c-b309-9960b29027e7sbnmd0mu.img {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:50 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.d94b10a7-8927-402c-b309-9960b29027e7sbnmd0mu.img Sep 02 16:22:50 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:52 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=34,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:22:57 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.d94b10a7-8927-402c-b309-9960b29027e7sbnmd0mu.img" returned: 0 in 7.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb3e09-b001-49f1-9f4d-216e2800c64c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:22:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:22:57 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:22:57 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:22:58 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 02 16:22:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.677s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:22:58 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.d94b10a7-8927-402c-b309-9960b29027e7sbnmd0mu.img {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:22:58 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Converted 1024.00 MB image at 141.11 MB/s Sep 02 16:22:58 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] d94b10a7-8927-402c-b309-9960b29027e7 was raw, no need to convert to raw {{(pid=87051) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 16:23:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1c67b405-c4e2-410c-a6b0-9b5a6a297567 tempest-GroupSnapshotsV319Test-955252623 None] Group tempest-GroupSnapshotsV319Test-Group-1056948671: creating Sep 02 16:23:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1c67b405-c4e2-410c-a6b0-9b5a6a297567 tempest-GroupSnapshotsV319Test-955252623 None] Group tempest-GroupSnapshotsV319Test-Group-1056948671: created successfully Sep 02 16:23:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1c67b405-c4e2-410c-a6b0-9b5a6a297567 tempest-GroupSnapshotsV319Test-955252623 None] Create group completed successfully. Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Flow 'volume_create_manager' (b84ba90c-c57d-471b-9024-92c09b0e7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15876517-a2d0-46b1-8550-690121317d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15876517-a2d0-46b1-8550-690121317d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060909259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=468f2055-9b8a-4ff2-a6fc-d318aeb3277f,host='devstack@QuobyteHD#QuobyteHD',id=3acd1907-9ef1-4557-b7de-31db7d6af38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73583994cb484677b6bac57b19b6f6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:02Z,use_quota=True,user_id='31bb9ee285ed4228862773f314c0a505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347697c3-b170-4725-8f81-3e701f0a1e61),volume_type_id=347697c3-b170-4725-8f81-3e701f0a1e61)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996ba23-5424-44d3-898e-06e9318ce957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996ba23-5424-44d3-898e-06e9318ce957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dd57f-d1f5-406b-81b0-c6f43ac5cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dd57f-d1f5-406b-81b0-c6f43ac5cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3acd1907-9ef1-4557-b7de-31db7d6af38f', 'volume_name': 'volume-3acd1907-9ef1-4557-b7de-31db7d6af38f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f44547c-d353-41f2-b2b3-23c9a0e98a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f44547c-d353-41f2-b2b3-23c9a0e98a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21f425f-cc62-4458-8e48-9b0e9855bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:02 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Volume 3acd1907-9ef1-4557-b7de-31db7d6af38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3acd1907-9ef1-4557-b7de-31db7d6af38f', 'volume_size': 1} Sep 02 16:23:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:23:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=43,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:23:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-2bfb40ed-e27b-43db-beed-159affccf422 req-516e9623-1af6-42b7-8c3f-28aaa85da711 tempest-AttachVolumeNegativeTest-639539955 None] Terminate volume connection completed successfully. Sep 02 16:23:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-2bfb40ed-e27b-43db-beed-159affccf422 req-516e9623-1af6-42b7-8c3f-28aaa85da711 tempest-AttachVolumeNegativeTest-639539955 None] Deleting attachment ee754cee-b7a2-458c-af9f-7001ee0aacdc. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.979s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Uploaded volume to glance image-id: d94b10a7-8927-402c-b309-9960b29027e7. {{(pid=87051) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.780s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=468f2055-9b8a-4ff2-a6fc-d318aeb3277f,created_at=2026-09-02T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060909259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=468f2055-9b8a-4ff2-a6fc-d318aeb3277f,host='devstack@QuobyteHD#QuobyteHD',id=3acd1907-9ef1-4557-b7de-31db7d6af38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73583994cb484677b6bac57b19b6f6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:02Z,use_quota=True,user_id='31bb9ee285ed4228862773f314c0a505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347697c3-b170-4725-8f81-3e701f0a1e61),volume_type_id=347697c3-b170-4725-8f81-3e701f0a1e61)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Creating volume 3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:23:20 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:20 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f 1073741824 Sep 02 16:23:20 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0aab10ce-c119-4984-8b75-979ef6257612 tempest-VolumesActionsTest-1695936643 None] Copy volume to image completed successfully. Sep 02 16:23:20 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f 1073741824" returned: 0 in 0.523s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:20 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f Sep 02 16:23:20 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:20 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f" returned: 0 in 0.277s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:23:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21f425f-cc62-4458-8e48-9b0e9855bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3acd1907-9ef1-4557-b7de-31db7d6af38f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64fb52b-6bb4-4864-8de1-179f3abebcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:21 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Volume volume-3acd1907-9ef1-4557-b7de-31db7d6af38f (3acd1907-9ef1-4557-b7de-31db7d6af38f): created successfully Sep 02 16:23:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64fb52b-6bb4-4864-8de1-179f3abebcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Flow 'volume_create_manager' (b84ba90c-c57d-471b-9024-92c09b0e7045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-db7100c7-b883-4e04-aa32-80424a692f04 tempest-GroupSnapshotsV319Test-955252623 None] Created volume successfully. Sep 02 16:23:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] GroupSnapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: creating. Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Group snapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: creating. {{(pid=87051) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Creating offline snapshot 93a91192-a29f-46d7-8c53-717fa1cb7199 of volume 3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49cc52-eea1-406d-9b25-f30f307968e9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:22 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f Sep 02 16:23:22 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:22 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f" returned: 0 in 0.361s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:22 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 1G Sep 02 16:23:22 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:22 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 1G" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acd1907-9ef1-4557-b7de-31db7d6af38f -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:22 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acd1907-9ef1-4557-b7de-31db7d6af38f -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 Sep 02 16:23:22 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:23 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acd1907-9ef1-4557-b7de-31db7d6af38f -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:23 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:23 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 Sep 02 16:23:23 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:23 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199" returned: 0 in 0.243s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:23 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info Sep 02 16:23:23 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:23 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info" returned: 0 in 0.254s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:23 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:23:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:23 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info Sep 02 16:23:23 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:24 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.info" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.948s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a611ef-faae-4e08-b37f-ac73fab7e5a2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-55d3223d-05ec-42c1-8e38-05d10a450611 tempest-GroupSnapshotsV319Test-955252623 None] group_snapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: created successfully Sep 02 16:23:24 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:23:24 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:24 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d6bdb-ee94-45d5-b225-50d8590a3823]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:24 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:23:24 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:25 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.421s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:25 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img Sep 02 16:23:25 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] group_snapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: deleting Sep 02 16:23:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] group_snapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: deleting {{(pid=87051) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "cinder-quobyte-93a91192-a29f-46d7-8c53-717fa1cb7199" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-93a91192-a29f-46d7-8c53-717fa1cb7199" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Deleting offline snapshot 93a91192-a29f-46d7-8c53-717fa1cb7199 of volume 3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] snapshot_file for this snap is: volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e1ebe-7ba5-449a-9a41-7e57f9ec0e50]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:26 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 Sep 02 16:23:26 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:27 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199" returned: 0 in 0.969s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3acd1907-9ef1-4557-b7de-31db7d6af38f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[038bf44b-35b6-4258-a17c-ef6feb59ad4c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:27 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f Sep 02 16:23:27 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:27 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f" returned: 0 in 0.639s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:28 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 Sep 02 16:23:28 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:28 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199" returned: 0 in 0.561s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:28 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199 Sep 02 16:23:28 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:29 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f.93a91192-a29f-46d7-8c53-717fa1cb7199" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-93a91192-a29f-46d7-8c53-717fa1cb7199" released by "_delete_snapshot" :: held 2.978s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" released by "delete_snapshot" :: held 3.031s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:29 devstack cinder-volume[87051]: WARNING cinder.quota [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1116398803 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1116398803, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:23:29 devstack cinder-volume[87051]: WARNING cinder.quota [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1116398803 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1116398803, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:23:29 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] Created reservations ['3fadfd7d-5786-4243-ab85-91e57669082b', '35060195-fed1-4ec9-8e06-0cffb102796a', 'e2f4b5f6-04c4-41ab-adfd-b85deb53c8f2', 'e1f976f3-d6f3-4975-b00a-c495d91a9d6b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1f58691e-23f9-4f0f-b0b8-52a8d09e5cf6 tempest-GroupSnapshotsV319Test-955252623 None] group_snapshot 7b35f7ea-7772-4024-8143-bc2af5299d69: deleted successfully Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:31 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img" returned: 0 in 6.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24bf65d-f54d-4580-a89e-8d074683640b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c8d7ab-1806-4004-8dcb-ae842c5a2ca7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:31 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:23:31 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:31 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f Sep 02 16:23:31 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:31 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f" returned: 0 in 0.511s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:31 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f Sep 02 16:23:31 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:32 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.882s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:23:32 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Converted 1024.00 MB image at 163.40 MB/s Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] 3bfb966f-05bf-4adc-bf27-ffbf204799a6 was raw, converting to qcow2 {{(pid=87051) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a80c7b-8511-49d8-9d65-642e6b6cd007]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:32 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3acd1907-9ef1-4557-b7de-31db7d6af38f" returned: 0 in 0.480s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Lock "cinder-quobyte-3acd1907-9ef1-4557-b7de-31db7d6af38f" released by "delete_volume" :: held 1.137s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:32 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img Sep 02 16:23:32 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Created reservations ['691fe4c2-adbf-4e50-91d5-472e6bac87ab'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:32 devstack cinder-volume[87051]: WARNING cinder.quota [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1116398803 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1116398803, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Created reservations ['cdc6b891-55ae-4bad-84a8-c2d1f4fb0eb6', '8879848c-6a1e-4218-8df9-1624b272a54e', '3eabbfdf-98ed-4979-a9ff-6be640183a73', 'fe306718-b520-4f4a-a2a6-1ec6c79ea4c1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:32 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img" returned: 0 in 0.635s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:33 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:23:33 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:33 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img Sep 02 16:23:33 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:33 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.436s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:23:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-731e85dc-e56c-4381-be61-28b2008a948a tempest-GroupSnapshotsV319Test-955252623 None] Delete group completed successfully. Sep 02 16:23:33 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img" returned: 1 in 0.588s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:33 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4 Sep 02 16:23:33 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:33 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Image conversion details: src /opt/stack/data/cinder/conversion/02695100-40e1-4737-8f96-2b0189b0a3ca.temp_image.3bfb966f-05bf-4adc-bf27-ffbf204799a6l3mr5txn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:23:33 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a9a170-7fe3-4a21-89a7-990db8a13195]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:34 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4 Sep 02 16:23:34 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:34 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oqh65jz4" returned: 0 in 0.457s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.369s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Uploaded volume to glance image-id: 3bfb966f-05bf-4adc-bf27-ffbf204799a6. {{(pid=87051) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 16:23:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-408171a1-dd04-461d-b6ac-9241611e195b tempest-VolumesActionsTest-1695936643 None] Copy volume to image completed successfully. Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "cinder-quobyte-02695100-40e1-4737-8f96-2b0189b0a3ca" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-quobyte-02695100-40e1-4737-8f96-2b0189b0a3ca" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb549918-f75d-4ea8-888a-3a0a630e67ec]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:38 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:23:38 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:38 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:38 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca Sep 02 16:23:38 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:38 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-02695100-40e1-4737-8f96-2b0189b0a3ca" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-quobyte-02695100-40e1-4737-8f96-2b0189b0a3ca" released by "delete_volume" :: held 0.750s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Created reservations ['a364128f-776f-418a-8793-3cc3624d592b', '7310fcb5-9a97-4e01-8954-2c0fe512f43a', 'd4a00ddd-3a79-473c-941b-de9568a68466', '82de05f4-8ea9-4aac-92b3-1e1f1e344e3c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:39 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:23:39 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:39 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:23:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Deleted volume successfully. Sep 02 16:23:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-776fdf41-dde4-491b-b27b-1b5fe7a799c4 tempest-VolumesActionsTest-1695936643 None] Lock "cinder-02695100-40e1-4737-8f96-2b0189b0a3ca-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6646e4c0-0b99-4b0c-8555-c11d6a994707 tempest-GroupsTest-163638045 None] Group tempest-Group1-996069688: creating Sep 02 16:23:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6646e4c0-0b99-4b0c-8555-c11d6a994707 tempest-GroupsTest-163638045 None] Group tempest-Group1-996069688: created successfully Sep 02 16:23:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6646e4c0-0b99-4b0c-8555-c11d6a994707 tempest-GroupsTest-163638045 None] Create group completed successfully. Sep 02 16:23:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-89107313-f80d-41dc-ba0e-aabc6e8b501a tempest-GroupsTest-163638045 None] Group tempest-Group2-1713555956: creating Sep 02 16:23:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-89107313-f80d-41dc-ba0e-aabc6e8b501a tempest-GroupsTest-163638045 None] Group tempest-Group2-1713555956: created successfully Sep 02 16:23:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-89107313-f80d-41dc-ba0e-aabc6e8b501a tempest-GroupsTest-163638045 None] Create group completed successfully. Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (55878be3-a205-4aa3-b89d-74a6539b304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0830b-9fe4-4c86-88d5-1ec68d6daf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0830b-9fe4-4c86-88d5-1ec68d6daf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657442087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1db837d3-6f82-41c9-b8ac-abbe863bf134,host='devstack@QuobyteHD#QuobyteHD',id=f9b4ae26-c580-418c-a8e9-c5528b02549f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:44Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5129f7d2-6698-40ef-a3c3-cb6911de0e90),volume_type_id=5129f7d2-6698-40ef-a3c3-cb6911de0e90)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18a913f-8a7d-4938-9861-610546e54e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18a913f-8a7d-4938-9861-610546e54e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfd548e-2038-4cac-9338-3b62270d5dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfd548e-2038-4cac-9338-3b62270d5dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b4ae26-c580-418c-a8e9-c5528b02549f', 'volume_name': 'volume-f9b4ae26-c580-418c-a8e9-c5528b02549f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222e56d-7650-4faf-8379-ca524c9c63cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222e56d-7650-4faf-8379-ca524c9c63cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32b4440-0505-49f2-a189-60d1e3413bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:43 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Volume f9b4ae26-c580-418c-a8e9-c5528b02549f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b4ae26-c580-418c-a8e9-c5528b02549f', 'volume_size': 1} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1db837d3-6f82-41c9-b8ac-abbe863bf134,created_at=2026-09-02T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657442087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1db837d3-6f82-41c9-b8ac-abbe863bf134,host='devstack@QuobyteHD#QuobyteHD',id=f9b4ae26-c580-418c-a8e9-c5528b02549f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:44Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5129f7d2-6698-40ef-a3c3-cb6911de0e90),volume_type_id=5129f7d2-6698-40ef-a3c3-cb6911de0e90)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Creating volume f9b4ae26-c580-418c-a8e9-c5528b02549f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:23:43 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:23:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:43 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f 1073741824 Sep 02 16:23:43 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:44 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f 1073741824" returned: 0 in 0.559s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:44 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f Sep 02 16:23:44 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:44 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f" returned: 0 in 0.368s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32b4440-0505-49f2-a189-60d1e3413bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b4ae26-c580-418c-a8e9-c5528b02549f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0106ff03-3c98-42cb-b5dc-82b8deccf1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:44 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Volume volume-f9b4ae26-c580-418c-a8e9-c5528b02549f (f9b4ae26-c580-418c-a8e9-c5528b02549f): created successfully Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0106ff03-3c98-42cb-b5dc-82b8deccf1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (55878be3-a205-4aa3-b89d-74a6539b304e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8844a55b-f381-437b-9ce8-735ab1944b59 tempest-GroupsTest-163638045 None] Created volume successfully. Sep 02 16:23:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Acquiring lock "cinder-quobyte-f9b4ae26-c580-418c-a8e9-c5528b02549f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-f9b4ae26-c580-418c-a8e9-c5528b02549f" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:46 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[840881da-abbd-4970-8ff5-b6eeb26eab81]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:46 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f Sep 02 16:23:46 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:47 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f" returned: 0 in 0.425s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:47 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f Sep 02 16:23:47 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Flow 'volume_create_manager' (dba5c988-e3f7-4b8f-bc35-08c0ed7747a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f69e9f0-730a-4bc5-9d9e-0cfc108170f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f69e9f0-730a-4bc5-9d9e-0cfc108170f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1399213865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e163e3-88ed-4e51-8c0f-b65471adc38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5ac6bfd3ce45b7b114355ea463916a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:47Z,use_quota=True,user_id='e3acc49740a84695b544841aac463be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f216de1-abb7-4c47-bbed-3307dc6661f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f216de1-abb7-4c47-bbed-3307dc6661f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16b2254-cbb5-4766-b5e3-d123c4c08fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16b2254-cbb5-4766-b5e3-d123c4c08fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e163e3-88ed-4e51-8c0f-b65471adc38d', 'volume_name': 'volume-17e163e3-88ed-4e51-8c0f-b65471adc38d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ed4fba-4f62-466b-ad3f-3eb57e36b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ed4fba-4f62-466b-ad3f-3eb57e36b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982267f-1d95-4490-a04e-aceec65c4cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Volume 17e163e3-88ed-4e51-8c0f-b65471adc38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e163e3-88ed-4e51-8c0f-b65471adc38d', 'volume_size': 1} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1399213865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e163e3-88ed-4e51-8c0f-b65471adc38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5ac6bfd3ce45b7b114355ea463916a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:47Z,use_quota=True,user_id='e3acc49740a84695b544841aac463be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Creating volume 17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:23:47 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:47 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d 1073741824 Sep 02 16:23:47 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:47 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f9b4ae26-c580-418c-a8e9-c5528b02549f" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-f9b4ae26-c580-418c-a8e9-c5528b02549f" released by "delete_volume" :: held 0.742s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Created reservations ['314dec88-4460-43e9-8bd4-6c669f535a55'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:47 devstack cinder-volume[87051]: WARNING cinder.quota [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1642312675 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1642312675, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:23:47 devstack cinder-volume[87051]: WARNING cinder.quota [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1642312675 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1642312675, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Created reservations ['471dbea8-03df-48b9-8c4a-f3ad82a6e00c', '6d8deb24-f302-4b12-8404-2513ca1adc7b', '3eef238f-abf6-4e2c-a2df-011084ee3566', '180b3dc3-15e4-4ba3-92ce-108c86365cbc'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:47 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:23:47 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:47 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d 1073741824" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:47 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:23:47 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:47 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.282s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:47 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:23:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-de88eb3e-d5a9-44f9-8311-07c0e6e3497e tempest-GroupsTest-163638045 None] Delete group completed successfully. Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Created reservations ['061fdd06-fa01-48d4-b567-177af0098d6c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:48 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:23:48 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:48 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982267f-1d95-4490-a04e-aceec65c4cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e163e3-88ed-4e51-8c0f-b65471adc38d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f66f7f7-bb0c-4cc5-b418-b9410eb33866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Volume volume-17e163e3-88ed-4e51-8c0f-b65471adc38d (17e163e3-88ed-4e51-8c0f-b65471adc38d): created successfully Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f66f7f7-bb0c-4cc5-b418-b9410eb33866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Flow 'volume_create_manager' (dba5c988-e3f7-4b8f-bc35-08c0ed7747a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-51737336-aa91-4ef2-ba20-024fed4bb29f tempest-VolumesCloneTest-1202125509 None] Created volume successfully. Sep 02 16:23:48 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:23:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5ef9d7bd-7282-4cbc-ac28-db5df66e22f6 tempest-GroupsTest-163638045 None] Delete group completed successfully. Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:48 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:23:48 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:48 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.232s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:23:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:23:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d87d77c8-91a5-4936-b82a-4eba227e5f68 tempest-GroupsTest-163638045 None] Group tempest-GroupsTest-Group-982371284: creating Sep 02 16:23:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d87d77c8-91a5-4936-b82a-4eba227e5f68 tempest-GroupsTest-163638045 None] Group tempest-GroupsTest-Group-982371284: created successfully Sep 02 16:23:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d87d77c8-91a5-4936-b82a-4eba227e5f68 tempest-GroupsTest-163638045 None] Create group completed successfully. Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Flow 'volume_create_manager' (bff9cabc-22e9-483c-be69-d787a3e818ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900a2469-a6da-4115-b898-08c845453e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900a2469-a6da-4115-b898-08c845453e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-967796838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a5797d-301e-4985-acb6-9b850552c77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5ac6bfd3ce45b7b114355ea463916a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=17e163e3-88ed-4e51-8c0f-b65471adc38d,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:50Z,use_quota=True,user_id='e3acc49740a84695b544841aac463be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b99c48d-ca9a-4ca0-a601-22bfd4962173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b99c48d-ca9a-4ca0-a601-22bfd4962173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c133689-bdc5-452d-a705-8a6767c9d4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c133689-bdc5-452d-a705-8a6767c9d4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72a5797d-301e-4985-acb6-9b850552c77c', 'volume_name': 'volume-72a5797d-301e-4985-acb6-9b850552c77c', 'volume_size': 2, 'source_volid': '17e163e3-88ed-4e51-8c0f-b65471adc38d', 'source_volstatus': 'available'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83469272-aada-44ea-b659-3a9548cb0c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83469272-aada-44ea-b659-3a9548cb0c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0674fb86-12a6-4aea-bbd2-570198b9838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:49 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Volume 72a5797d-301e-4985-acb6-9b850552c77c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72a5797d-301e-4985-acb6-9b850552c77c', 'volume_size': 2, 'source_volid': '17e163e3-88ed-4e51-8c0f-b65471adc38d', 'source_volstatus': 'available'} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:49 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Cloning volume 17e163e3-88ed-4e51-8c0f-b65471adc38d to volume 72a5797d-301e-4985-acb6-9b850552c77c Sep 02 16:23:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Creating offline snapshot 5efdc803-2b8e-48d7-977a-bd731edae9a0 of volume 17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95939b9d-1fd5-4561-a0ad-222f54853117]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:50 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:23:50 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:50 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:50 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 1G Sep 02 16:23:50 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:50 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 1G" returned: 0 in 0.451s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e163e3-88ed-4e51-8c0f-b65471adc38d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:50 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e163e3-88ed-4e51-8c0f-b65471adc38d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:50 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:51 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e163e3-88ed-4e51-8c0f-b65471adc38d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:51 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 is being set with open permissions: ugo+rw Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:51 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:51 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (45cc079b-a42a-4d79-a5a3-8dc56ffb389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533da197-0d56-400f-bc6e-3ead59b45ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533da197-0d56-400f-bc6e-3ead59b45ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112606454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1979a391-0ee1-4816-affc-5ba9c9c92762,host='devstack@QuobyteHD#QuobyteHD',id=d85e7028-d302-4eca-8e54-daaa4bd87416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:51Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18644e-202a-4a67-9c5d-be33c2085320),volume_type_id=8f18644e-202a-4a67-9c5d-be33c2085320)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0675a1-6d13-4327-860c-37e505720b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0675a1-6d13-4327-860c-37e505720b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64249c2f-6c28-4129-b93c-066a5623858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64249c2f-6c28-4129-b93c-066a5623858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85e7028-d302-4eca-8e54-daaa4bd87416', 'volume_name': 'volume-d85e7028-d302-4eca-8e54-daaa4bd87416', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18446073-9de8-4900-94c5-019f5022d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18446073-9de8-4900-94c5-019f5022d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef5af4-c1ea-4753-ac0c-e5febb40d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Volume d85e7028-d302-4eca-8e54-daaa4bd87416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85e7028-d302-4eca-8e54-daaa4bd87416', 'volume_size': 1} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:51 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:51 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info Sep 02 16:23:51 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:51 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info" returned: 0 in 0.239s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:51 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info is being set with open permissions: ugo+rw Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:51 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info Sep 02 16:23:51 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:51 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.info" returned: 0 in 0.248s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] snapshot: 5efdc803-2b8e-48d7-977a-bd731edae9a0, volume: 72a5797d-301e-4985-acb6-9b850552c77c, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89db892-bd85-4bfe-8a90-21d3ac9ebb13]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:52 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:52 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:52 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.345s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e163e3-88ed-4e51-8c0f-b65471adc38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[27468f98-071b-4dad-b2b9-8107e5772880]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:52 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:23:52 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:52 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:23:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:52 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c Sep 02 16:23:52 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:57 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c" returned: 0 in 5.049s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:57 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:23:57 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Converted 1024.00 MB image at 202.64 MB/s Sep 02 16:23:57 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c is being set with open permissions: ugo+rw Sep 02 16:23:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:57 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c Sep 02 16:23:57 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:57 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" released by "_copy_volume_from_snapshot" :: held 6.106s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-quobyte-5efdc803-2b8e-48d7-977a-bd731edae9a0" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-5efdc803-2b8e-48d7-977a-bd731edae9a0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Deleting offline snapshot 5efdc803-2b8e-48d7-977a-bd731edae9a0 of volume 17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] snapshot_file for this snap is: volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe8b94-1751-4c22-9d06-7b2d55971fc4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (ccc3817d-6d7b-4905-9c94-b132e85b8a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a3c53-f0b4-44a1-9075-1992dbb6ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a3c53-f0b4-44a1-9075-1992dbb6ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-272054238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d7680-d699-45d8-9446-2437481f11d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:58Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484da612-9ac1-4667-a174-7584eb6e5076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484da612-9ac1-4667-a174-7584eb6e5076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a2fdaf-20ba-480b-aede-6728dbe5c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a2fdaf-20ba-480b-aede-6728dbe5c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5d7680-d699-45d8-9446-2437481f11d3', 'volume_name': 'volume-3a5d7680-d699-45d8-9446-2437481f11d3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e261b3-ee63-4221-bcf4-d3f3ba515135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e261b3-ee63-4221-bcf4-d3f3ba515135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2675f079-2361-4e81-8268-9a75cf701358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:58 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Volume 3a5d7680-d699-45d8-9446-2437481f11d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5d7680-d699-45d8-9446-2437481f11d3', 'volume_size': 1} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:58 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:58 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:58 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e163e3-88ed-4e51-8c0f-b65471adc38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b5e6f-e20d-483b-a69d-e54332260402]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:58 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:23:58 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:58 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.548s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:59 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:59 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:59 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.324s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:59 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0 Sep 02 16:23:59 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:59 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d.5efdc803-2b8e-48d7-977a-bd731edae9a0" returned: 0 in 0.239s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-5efdc803-2b8e-48d7-977a-bd731edae9a0" released by "_delete_snapshot" :: held 1.549s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.675s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.308s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1979a391-0ee1-4816-affc-5ba9c9c92762,created_at=2026-09-02T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112606454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1979a391-0ee1-4816-affc-5ba9c9c92762,host='devstack@QuobyteHD#QuobyteHD',id=d85e7028-d302-4eca-8e54-daaa4bd87416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:51Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18644e-202a-4a67-9c5d-be33c2085320),volume_type_id=8f18644e-202a-4a67-9c5d-be33c2085320)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Creating volume d85e7028-d302-4eca-8e54-daaa4bd87416 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:23:59 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:23:59 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 1073741824 Sep 02 16:23:59 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0674fb86-12a6-4aea-bbd2-570198b9838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a5797d-301e-4985-acb6-9b850552c77c', 'volume_size': 2, 'source_volid': '17e163e3-88ed-4e51-8c0f-b65471adc38d', 'source_volstatus': 'available'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75337c0-fad6-4be9-9982-341575c9d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:23:59 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Volume volume-72a5797d-301e-4985-acb6-9b850552c77c (72a5797d-301e-4985-acb6-9b850552c77c): created successfully Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75337c0-fad6-4be9-9982-341575c9d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Flow 'volume_create_manager' (bff9cabc-22e9-483c-be69-d787a3e818ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:23:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-87484663-50de-459b-80b2-7fb25b1db92a tempest-VolumesCloneTest-1202125509 None] Created volume successfully. Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-72a5797d-301e-4985-acb6-9b850552c77c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:23:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "cinder-72a5797d-301e-4985-acb6-9b850552c77c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82af35-a527-47c1-9ee5-376bb9037239]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 1073741824" returned: 0 in 0.521s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c Sep 02 16:24:00 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:00 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 Sep 02 16:24:00 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:00 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416" returned: 0 in 0.254s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-272054238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d7680-d699-45d8-9446-2437481f11d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:23:58Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Creating volume 3a5d7680-d699-45d8-9446-2437481f11d3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:00 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c" returned: 0 in 0.427s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 1073741824 Sep 02 16:24:00 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef5af4-c1ea-4753-ac0c-e5febb40d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85e7028-d302-4eca-8e54-daaa4bd87416', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635b821-7931-4787-b88e-175fd3f5c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:00 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c Sep 02 16:24:00 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Volume volume-d85e7028-d302-4eca-8e54-daaa4bd87416 (d85e7028-d302-4eca-8e54-daaa4bd87416): created successfully Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635b821-7931-4787-b88e-175fd3f5c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (45cc079b-a42a-4d79-a5a3-8dc56ffb389f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1a1f16af-0106-4b2e-846b-7ffb4f94b7e6 tempest-GroupsTest-163638045 None] Created volume successfully. Sep 02 16:24:00 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-72a5797d-301e-4985-acb6-9b850552c77c" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-72a5797d-301e-4985-acb6-9b850552c77c" released by "delete_volume" :: held 0.751s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Created reservations ['0471e5f9-023c-46b4-a647-6625bb0196f5', '06646164-624d-4b8e-9c3d-403a6e70e504', 'bc1dac6d-8038-46bb-bcc0-a10b2ba09546', '0300a0b6-2d54-4a1c-bba0-2aab588cca33'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:00 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:00 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 1073741824" returned: 0 in 0.462s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:00 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 Sep 02 16:24:00 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:01 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.275s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Deleted volume successfully. Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-167d6b9c-87ee-45b7-96b0-b11fdfceb051 tempest-VolumesCloneTest-1202125509 None] Lock "cinder-72a5797d-301e-4985-acb6-9b850552c77c-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:01 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-17e163e3-88ed-4e51-8c0f-b65471adc38d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2675f079-2361-4e81-8268-9a75cf701358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5d7680-d699-45d8-9446-2437481f11d3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4349c0-3f28-4aec-8218-21357a5b5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "cinder-17e163e3-88ed-4e51-8c0f-b65471adc38d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Volume volume-3a5d7680-d699-45d8-9446-2437481f11d3 (3a5d7680-d699-45d8-9446-2437481f11d3): created successfully Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4349c0-3f28-4aec-8218-21357a5b5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (ccc3817d-6d7b-4905-9c94-b132e85b8a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8ccbefe4-4164-416b-98c6-7f3723bfe323 tempest-AttachVolumeNegativeTest-639539955 None] Created volume successfully. Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Acquiring lock "cinder-quobyte-17e163e3-88ed-4e51-8c0f-b65471adc38d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-17e163e3-88ed-4e51-8c0f-b65471adc38d" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610bf2b-c0c4-4066-9eda-2e4369e71833]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:01 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:24:01 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:01 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.403s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:01 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d Sep 02 16:24:01 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (2f5797ca-293b-44c0-b0bf-4d4d767fa409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d0ef6-4c39-4016-acf1-3b0202661f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d0ef6-4c39-4016-acf1-3b0202661f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748428864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1979a391-0ee1-4816-affc-5ba9c9c92762,host='devstack@QuobyteHD#QuobyteHD',id=5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:02Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18644e-202a-4a67-9c5d-be33c2085320),volume_type_id=8f18644e-202a-4a67-9c5d-be33c2085320)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec505a71-1eab-4904-8700-9bdecafba0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec505a71-1eab-4904-8700-9bdecafba0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1807ec7-940b-44bb-84b1-7e08a8b4cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1807ec7-940b-44bb-84b1-7e08a8b4cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98', 'volume_name': 'volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fe6741-58da-4dcd-9470-5890321951a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fe6741-58da-4dcd-9470-5890321951a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b778d-4f38-449f-af2f-8fd78b230ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Volume 5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98', 'volume_size': 1} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1979a391-0ee1-4816-affc-5ba9c9c92762,created_at=2026-09-02T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748428864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1979a391-0ee1-4816-affc-5ba9c9c92762,host='devstack@QuobyteHD#QuobyteHD',id=5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff0130dd7e463b84dea412677e95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:02Z,use_quota=True,user_id='8d4928b0f95f4e609f6aa2fe2fe59a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18644e-202a-4a67-9c5d-be33c2085320),volume_type_id=8f18644e-202a-4a67-9c5d-be33c2085320)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Creating volume 5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:01 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:02 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 1073741824 Sep 02 16:24:02 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:02 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-17e163e3-88ed-4e51-8c0f-b65471adc38d" returned: 0 in 0.254s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "cinder-quobyte-17e163e3-88ed-4e51-8c0f-b65471adc38d" released by "delete_volume" :: held 0.717s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Created reservations ['6ecb004d-831c-40b1-a095-abff427bdf7e', 'be99a18f-786f-4f0d-9588-0a5298f5f4c7', '6ed8e064-ba80-49bf-815a-28d270182a7e', 'd9038d02-2cba-4a79-993d-e386a3b91096'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:02 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:02 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:02 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 1073741824" returned: 0 in 0.536s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:02 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Deleted volume successfully. Sep 02 16:24:02 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 Sep 02 16:24:02 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0671c057-ee21-49ae-a6eb-db3fd886deef tempest-VolumesCloneTest-1202125509 None] Lock "cinder-17e163e3-88ed-4e51-8c0f-b65471adc38d-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:02 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" returned: 0 in 0.269s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b778d-4f38-449f-af2f-8fd78b230ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54b3b05-9cf6-407c-b353-8c8dddd48601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:02 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Volume volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 (5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98): created successfully Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54b3b05-9cf6-407c-b353-8c8dddd48601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Flow 'volume_create_manager' (2f5797ca-293b-44c0-b0bf-4d4d767fa409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e7d1439d-9d87-4132-a2dc-0d992350cf2b tempest-GroupsTest-163638045 None] Created volume successfully. Sep 02 16:24:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-100c2372-fb92-4e50-b56b-14f8ff80f785 tempest-GroupsTest-163638045 None] Update group completed successfully. Sep 02 16:24:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-8f02de44-a372-4918-b7f9-5e6ad15cfce8 req-1aa893d4-9b93-4aaa-8836-c986959d2d27 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-8f02de44-a372-4918-b7f9-5e6ad15cfce8 req-1aa893d4-9b93-4aaa-8836-c986959d2d27 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-8f02de44-a372-4918-b7f9-5e6ad15cfce8 req-1aa893d4-9b93-4aaa-8836-c986959d2d27 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:03 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-8f02de44-a372-4918-b7f9-5e6ad15cfce8 req-1aa893d4-9b93-4aaa-8836-c986959d2d27 tempest-AttachVolumeNegativeTest-639539955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-3a5d7680-d699-45d8-9446-2437481f11d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1a8503a-1161-48b8-8198-5e1778904e4f', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:24:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-8f02de44-a372-4918-b7f9-5e6ad15cfce8 req-1aa893d4-9b93-4aaa-8836-c986959d2d27 tempest-AttachVolumeNegativeTest-639539955 None] attachment_update completed successfully. Sep 02 16:24:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b7ff6f58-c1ac-4990-bbbd-56f4f9a00a6b tempest-GroupsTest-163638045 None] Update group completed successfully. Sep 02 16:24:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Flow 'volume_create_manager' (39afc6cc-3cdf-4888-b3a2-5d1071e25f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d3ddb-9890-4f1f-9f47-0c5cec42a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d3ddb-9890-4f1f-9f47-0c5cec42a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1091270587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663a3c2d-4df7-4d29-887f-61f9837339f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dde67244c549318cedd49cbc6354eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:06Z,use_quota=True,user_id='ab11c913380840319966931b033b561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a58b7-0a15-4ea2-9bf1-15ea67f77dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a58b7-0a15-4ea2-9bf1-15ea67f77dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94bcdb4-90c5-4d1a-9e1a-081a2c8456fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:24:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-b9c14958-fd3c-49b5-97e9-63410e414f00 req-524a0e22-c495-4b9d-983b-d7a902ba718d tempest-AttachVolumeNegativeTest-639539955 None] Terminate volume connection completed successfully. Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-b9c14958-fd3c-49b5-97e9-63410e414f00 req-524a0e22-c495-4b9d-983b-d7a902ba718d tempest-AttachVolumeNegativeTest-639539955 None] Deleting attachment a1a8503a-1161-48b8-8198-5e1778904e4f. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94bcdb4-90c5-4d1a-9e1a-081a2c8456fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '663a3c2d-4df7-4d29-887f-61f9837339f6', 'volume_name': 'volume-663a3c2d-4df7-4d29-887f-61f9837339f6', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2474b381-b32b-4323-8cb8-d8b7bbd255dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2474b381-b32b-4323-8cb8-d8b7bbd255dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414761d7-8b56-43a2-b4e3-35d9c106fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Volume 663a3c2d-4df7-4d29-887f-61f9837339f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-663a3c2d-4df7-4d29-887f-61f9837339f6', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Trying to clone 663a3c2d-4df7-4d29-887f-61f9837339f6 from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Acquiring lock "cinder-quobyte-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9ff01-100c-4d5f-980e-17106938e3af]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:06 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 Sep 02 16:24:06 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:24:06 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Image download 20.69 MB at 20.69 MB/s Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84f39e7-46e9-43a3-9e4d-68daf008c31e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:06 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD Sep 02 16:24:06 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:07 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" returned: 0 in 0.476s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:07 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98 Sep 02 16:24:07 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:07 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd is fetched for user ab11c913380840319966931b033b561a. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ceb7b-697f-4655-b368-6df3f1a626ca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:07 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" returned: 0 in 0.342s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:07 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD Sep 02 16:24:07 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-5586d0fe-bc92-4b3c-b60d-d24ac0dc4e98" released by "delete_volume" :: held 0.888s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Acquiring lock "cinder-quobyte-d85e7028-d302-4eca-8e54-daaa4bd87416" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-d85e7028-d302-4eca-8e54-daaa4bd87416" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2576f84-d860-44d5-bf89-94f27ac17e4c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:07 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 Sep 02 16:24:07 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:07 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1091270587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663a3c2d-4df7-4d29-887f-61f9837339f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dde67244c549318cedd49cbc6354eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:06Z,use_quota=True,user_id='ab11c913380840319966931b033b561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Creating volume 663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:07 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:07 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1073741824 Sep 02 16:24:07 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:08 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416" returned: 0 in 0.579s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:08 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416 Sep 02 16:24:08 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:08 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d85e7028-d302-4eca-8e54-daaa4bd87416" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "cinder-quobyte-d85e7028-d302-4eca-8e54-daaa4bd87416" released by "delete_volume" :: held 0.950s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:08 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1073741824" returned: 0 in 0.625s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Created reservations ['758de1c6-3654-441f-92d7-f0cd97a0ec14'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:08 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 Sep 02 16:24:08 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:08 devstack cinder-volume[87051]: WARNING cinder.quota [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-705015602 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-705015602, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:24:08 devstack cinder-volume[87051]: WARNING cinder.quota [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-705015602 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-705015602, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Created reservations ['298b09a7-aee4-49f8-9847-40ff49f2eef1', '6bd74af1-95ba-4c56-9d22-5c851792a5cc', '4edb4621-0502-4153-b9bc-87a37747b701', '32e1e172-5ef1-40d3-b242-3d6b80f0f181'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Created reservations ['61511736-9da6-41c3-9082-36cd56107a66', '18383cff-5a5d-4e71-84b2-255da1c4213b', '8d96407b-2037-4add-be37-85c7b5834b26', 'c6875c42-8596-4beb-9915-6d374dc7bfa9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:08 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Attempting download of e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 663a3c2d-4df7-4d29-887f-61f9837339f6. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:08 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:08 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6260cf8c-9501-4cae-a11e-9e6eaa30a17f]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:09 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk Sep 02 16:24:09 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:09 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.345s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d6811edc-33a9-4c44-be1f-719855e26de6 tempest-GroupsTest-163638045 None] Delete group completed successfully. Sep 02 16:24:09 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk" returned: 0 in 0.533s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:09 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk Sep 02 16:24:09 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:09 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk" returned: 1 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_zizrqkjk' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d55b92-2236-406a-bbed-c8e5fa1f7342]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:09 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD Sep 02 16:24:09 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:10 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:10 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:24:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:10 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 Sep 02 16:24:10 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:12 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6" returned: 0 in 2.169s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_mg2c_ekcdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:24:12 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Converted 112.00 MB image at 51.61 MB/s Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:12 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1G Sep 02 16:24:12 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:12 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 1G" returned: 0 in 0.365s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Downloaded image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 663a3c2d-4df7-4d29-887f-61f9837339f6 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd for user ab11c913380840319966931b033b561a is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Marking volume 663a3c2d-4df7-4d29-887f-61f9837339f6 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=99,cinder:UPDATE=105,cinder:INSERT=25,cinder:DELETE=4 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Copying metadata from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd to 663a3c2d-4df7-4d29-887f-61f9837339f6. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Creating volume glance metadata for volume 663a3c2d-4df7-4d29-887f-61f9837339f6 backed by image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=104,cinder:INSERT=23,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414761d7-8b56-43a2-b4e3-35d9c106fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663a3c2d-4df7-4d29-887f-61f9837339f6', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75097464-3bd1-46da-b6cc-96f0b8d6e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Volume volume-663a3c2d-4df7-4d29-887f-61f9837339f6 (663a3c2d-4df7-4d29-887f-61f9837339f6): created successfully Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75097464-3bd1-46da-b6cc-96f0b8d6e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Flow 'volume_create_manager' (39afc6cc-3cdf-4888-b3a2-5d1071e25f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-815e4b05-101f-4017-8c83-d69ec46655b0 tempest-VolumesExtendTest-88132966 None] Created volume successfully. Sep 02 16:24:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:13 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2823a6-54fc-4333-b1c6-beb3a4af1cad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:13 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 Sep 02 16:24:13 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:14 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6" returned: 0 in 0.442s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 2G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 2G" returned: 0 in 0.135s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.626s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dd132d3d-14f6-4ea8-b8c7-eff01ce530cb tempest-VolumesExtendTest-88132966 None] Extend volume completed successfully. Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-663a3c2d-4df7-4d29-887f-61f9837339f6-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c533ee08-f2bd-4b06-aa3c-7ecaa960aca1 tempest-GroupsV314Test-1408423783 None] Group tempest-GroupsV314Test-Group-1439787566: creating Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "cinder-663a3c2d-4df7-4d29-887f-61f9837339f6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c533ee08-f2bd-4b06-aa3c-7ecaa960aca1 tempest-GroupsV314Test-1408423783 None] Group tempest-GroupsV314Test-Group-1439787566: created successfully Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-quobyte-663a3c2d-4df7-4d29-887f-61f9837339f6" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c533ee08-f2bd-4b06-aa3c-7ecaa960aca1 tempest-GroupsV314Test-1408423783 None] Create group completed successfully. Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-663a3c2d-4df7-4d29-887f-61f9837339f6" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8345510-4955-4f78-909e-ffc3bb91ea1d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:15 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 Sep 02 16:24:15 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:15 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:15 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6 Sep 02 16:24:15 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:15 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-663a3c2d-4df7-4d29-887f-61f9837339f6" returned: 0 in 0.265s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-663a3c2d-4df7-4d29-887f-61f9837339f6" released by "delete_volume" :: held 0.689s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:15 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Created reservations ['a9c35ab1-5cbb-4fd9-987c-24dd155e57c7', 'e2346879-a2b8-4140-9ff6-c774708cdf2d', '54cb25fc-8c25-442a-9151-f80509edfe69', '640b308d-dc09-4539-9f35-404122d8fcd4'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:16 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:16 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:16 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Deleted volume successfully. Sep 02 16:24:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ab71e381-2aac-4b86-a672-7bfb53a5da59 tempest-VolumesExtendTest-88132966 None] Lock "cinder-663a3c2d-4df7-4d29-887f-61f9837339f6-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Flow 'volume_create_manager' (61df32b9-9bde-4c7b-8afd-fb7fd3c1ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb79fe2-9b6d-4613-bd2b-f3fe63153a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb79fe2-9b6d-4613-bd2b-f3fe63153a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-144541179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48abae9d-7f05-49a5-8e44-cc5d7d825674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dde67244c549318cedd49cbc6354eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:17Z,use_quota=True,user_id='ab11c913380840319966931b033b561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a063c4c4-1d21-4014-9fc2-c76314c6f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a063c4c4-1d21-4014-9fc2-c76314c6f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c47ce7-1700-4e33-8d6a-05b376d08dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c47ce7-1700-4e33-8d6a-05b376d08dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48abae9d-7f05-49a5-8e44-cc5d7d825674', 'volume_name': 'volume-48abae9d-7f05-49a5-8e44-cc5d7d825674', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e0a8c0-23e5-4dd6-9910-cf3e221dfa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e0a8c0-23e5-4dd6-9910-cf3e221dfa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5425e2-3f56-4cae-b1f5-406b51a5850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Volume 48abae9d-7f05-49a5-8e44-cc5d7d825674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48abae9d-7f05-49a5-8e44-cc5d7d825674', 'volume_size': 1} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-144541179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48abae9d-7f05-49a5-8e44-cc5d7d825674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dde67244c549318cedd49cbc6354eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:17Z,use_quota=True,user_id='ab11c913380840319966931b033b561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Creating volume 48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:17 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 1073741824 Sep 02 16:24:17 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Flow 'volume_create_manager' (9badf436-8cc9-41b2-9be6-d8904f8bf6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df68c5e-6e80-46f6-a9fb-d3bbbcf099e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df68c5e-6e80-46f6-a9fb-d3bbbcf099e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-309369827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff9200d3-ff67-4682-aed7-b31453522976,host='devstack@QuobyteHD#QuobyteHD',id=507a2afa-83a7-4f54-bd89-a30efde0abd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce35e85beee4688a813f1a028d1542a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:17Z,use_quota=True,user_id='90618a9eaa7c4b1f9b63a6a0c5460c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09101bcf-2ec4-4d13-ae4b-cc5a979285df),volume_type_id=09101bcf-2ec4-4d13-ae4b-cc5a979285df)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d15fe-fe13-46cf-b2f7-e8fda2bed044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d15fe-fe13-46cf-b2f7-e8fda2bed044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9df4b8-a093-4e43-9af7-4c63f3a63fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9df4b8-a093-4e43-9af7-4c63f3a63fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507a2afa-83a7-4f54-bd89-a30efde0abd1', 'volume_name': 'volume-507a2afa-83a7-4f54-bd89-a30efde0abd1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b5994a-3075-4a3c-8d2e-d07342061197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b5994a-3075-4a3c-8d2e-d07342061197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a7f846-bbf1-4c56-979c-0df34313a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Volume 507a2afa-83a7-4f54-bd89-a30efde0abd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507a2afa-83a7-4f54-bd89-a30efde0abd1', 'volume_size': 1} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:17 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 1073741824" returned: 0 in 0.457s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:17 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:17 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:18 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff9200d3-ff67-4682-aed7-b31453522976,created_at=2026-09-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-309369827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff9200d3-ff67-4682-aed7-b31453522976,host='devstack@QuobyteHD#QuobyteHD',id=507a2afa-83a7-4f54-bd89-a30efde0abd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce35e85beee4688a813f1a028d1542a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:17Z,use_quota=True,user_id='90618a9eaa7c4b1f9b63a6a0c5460c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09101bcf-2ec4-4d13-ae4b-cc5a979285df),volume_type_id=09101bcf-2ec4-4d13-ae4b-cc5a979285df)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Creating volume 507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:18 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:18 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 1073741824 Sep 02 16:24:18 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5425e2-3f56-4cae-b1f5-406b51a5850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48abae9d-7f05-49a5-8e44-cc5d7d825674', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fda059-a47e-4ae2-8c98-e8cfd311b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Volume volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 (48abae9d-7f05-49a5-8e44-cc5d7d825674): created successfully Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fda059-a47e-4ae2-8c98-e8cfd311b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Flow 'volume_create_manager' (61df32b9-9bde-4c7b-8afd-fb7fd3c1ffab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5b0a7b32-534a-4451-9420-ea6da4f6ad85 tempest-VolumesExtendTest-88132966 None] Created volume successfully. Sep 02 16:24:18 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 1073741824" returned: 0 in 0.640s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:18 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:18 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:19 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.506s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a7f846-bbf1-4c56-979c-0df34313a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507a2afa-83a7-4f54-bd89-a30efde0abd1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79279a5e-0c73-4c50-8999-4155d41ab766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:19 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Volume volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 (507a2afa-83a7-4f54-bd89-a30efde0abd1): created successfully Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79279a5e-0c73-4c50-8999-4155d41ab766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Flow 'volume_create_manager' (9badf436-8cc9-41b2-9be6-d8904f8bf6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f251268e-926c-4df4-9c97-9daaf0baad70 tempest-GroupsV314Test-1408423783 None] Created volume successfully. Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Creating offline snapshot 7b89c277-05e7-43ef-b640-4b273c951a73 of volume 48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577a56b-01cf-483c-a87c-ef64089d0f2d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:20 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:20 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:20 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:20 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 1G Sep 02 16:24:20 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:21 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 1G" returned: 0 in 0.667s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:21 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 Sep 02 16:24:21 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:21 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73" returned: 0 in 0.423s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:21 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 is being set with open permissions: ugo+rw Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:21 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 Sep 02 16:24:21 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:21 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73" returned: 0 in 0.273s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:21 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info Sep 02 16:24:21 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:22 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info" returned: 0 in 0.296s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:22 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info is being set with open permissions: ugo+rw Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:22 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info Sep 02 16:24:22 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:22 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.info" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.848s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Cloning volume 507a2afa-83a7-4f54-bd89-a30efde0abd1 to volume 4ab64b59-cdb3-4ea3-b681-ccac4095b685 Sep 02 16:24:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-70d97c89-afd2-4804-8054-9d089954fa02 tempest-VolumesExtendTest-88132966 None] Create snapshot completed successfully Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Creating offline snapshot f8ade119-f501-4a6d-9792-5cb812e87cb1 of volume 507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b268ba6-593b-4fea-95dd-dfbb3e317bb6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:22 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:22 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:23 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:23 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 1G Sep 02 16:24:23 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:23 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 1G" returned: 0 in 0.408s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:23 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:23 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:23 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.311s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:23 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:24:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:23 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:23 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:24 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:24 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info Sep 02 16:24:24 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:24 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info" returned: 0 in 0.277s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:24 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:24 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info Sep 02 16:24:24 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:24 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.info" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Acquiring lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] snapshot: f8ade119-f501-4a6d-9792-5cb812e87cb1, volume: 4ab64b59-cdb3-4ea3-b681-ccac4095b685, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f43bde-0db7-499a-848e-8a4adc605d39]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:24 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:24 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:25 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.403s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-507a2afa-83a7-4f54-bd89-a30efde0abd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be15886-427e-4903-ab48-03eb5a182fd2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:25 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:25 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:25 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.424s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:25 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 Sep 02 16:24:25 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-264f0f48-8914-447f-968d-ce5392deba80 req-2f164ce7-a0f2-4376-b44d-9a87d4972f20 tempest-AttachVolumeTestJSON-1412095487 None] Terminate volume connection completed successfully. Sep 02 16:24:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-264f0f48-8914-447f-968d-ce5392deba80 req-2f164ce7-a0f2-4376-b44d-9a87d4972f20 tempest-AttachVolumeTestJSON-1412095487 None] Deleting attachment 7e953a22-23e4-4983-a9ea-1d4373e629ce. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:24:31 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685" returned: 0 in 6.143s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:31 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:24:31 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Converted 1024.00 MB image at 166.68 MB/s Sep 02 16:24:31 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:24:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:31 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 Sep 02 16:24:31 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:32 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685" returned: 0 in 0.448s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" released by "_copy_volume_from_snapshot" :: held 7.499s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Acquiring lock "cinder-quobyte-f8ade119-f501-4a6d-9792-5cb812e87cb1" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-f8ade119-f501-4a6d-9792-5cb812e87cb1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Deleting offline snapshot f8ade119-f501-4a6d-9792-5cb812e87cb1 of volume 507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] snapshot_file for this snap is: volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee6b40-1c2c-4435-af7a-246b8cbbe5ad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:32 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:32 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:32 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-507a2afa-83a7-4f54-bd89-a30efde0abd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c170d-2d60-4c8b-bf27-af0c6eaa2c35]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:32 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:32 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:33 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.721s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:33 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:33 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:33 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.359s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:33 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1 Sep 02 16:24:33 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:34 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1.f8ade119-f501-4a6d-9792-5cb812e87cb1" returned: 0 in 0.285s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-f8ade119-f501-4a6d-9792-5cb812e87cb1" released by "_delete_snapshot" :: held 1.919s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.796s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.299s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f7811d-211e-4564-8430-744a8b388fcd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-548a6b8a-a0ce-486f-85d4-b5f3c742de53 tempest-GroupsV314Test-1408423783 None] Create group from source-group-ff9200d3-ff67-4682-aed7-b31453522976 completed successfully. Sep 02 16:24:34 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:34 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:34 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.408s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 2G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 2G" returned: 0 in 0.137s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.603s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9e05b26e-d555-4dd0-ae9c-f1aebdf83c9f tempest-VolumesExtendTest-88132966 None] Extend volume completed successfully. Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-7b89c277-05e7-43ef-b640-4b273c951a73-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-7b89c277-05e7-43ef-b640-4b273c951a73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-quobyte-7b89c277-05e7-43ef-b640-4b273c951a73" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-7b89c277-05e7-43ef-b640-4b273c951a73" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Deleting offline snapshot 7b89c277-05e7-43ef-b640-4b273c951a73 of volume 48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] snapshot_file for this snap is: volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9bd73-af45-46fb-b12b-faf1797883dc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:35 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 Sep 02 16:24:35 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Acquiring lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928ac51-7789-443f-bbcf-683901644759]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:36 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 Sep 02 16:24:36 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:36 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48abae9d-7f05-49a5-8e44-cc5d7d825674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705428f-2474-4486-bf27-4ac259005904]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:36 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:36 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:36 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:36 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685 Sep 02 16:24:36 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:36 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.406s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:36 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4ab64b59-cdb3-4ea3-b681-ccac4095b685" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:36 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 Sep 02 16:24:36 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-4ab64b59-cdb3-4ea3-b681-ccac4095b685" released by "delete_volume" :: held 0.740s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Created reservations ['2b6901e4-6c90-4d02-a9c4-f6ecf27cdd81'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:36 devstack cinder-volume[87051]: WARNING cinder.quota [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-939238412 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-939238412, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:24:36 devstack cinder-volume[87051]: WARNING cinder.quota [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-939238412 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-939238412, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Created reservations ['d4f52ae3-8ccc-4e05-919a-9c2ca0d593d1', 'ceba480a-5152-4fc3-a141-bf31383ad3cb', 'c8ac1946-557e-4516-803a-945bdec53140', 'f7264b33-3e84-47e7-88ab-280756f27372'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:37 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:37 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:37 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73" returned: 0 in 0.425s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:37 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73 Sep 02 16:24:37 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:37 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.280s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-06e2ea8e-2716-4df5-b880-ae4c1efd04be tempest-GroupsV314Test-1408423783 None] Delete group completed successfully. Sep 02 16:24:37 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674.7b89c277-05e7-43ef-b640-4b273c951a73" returned: 0 in 0.285s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-7b89c277-05e7-43ef-b640-4b273c951a73" released by "_delete_snapshot" :: held 1.674s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" released by "delete_snapshot" :: held 1.708s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Acquiring lock "cinder-quobyte-507a2afa-83a7-4f54-bd89-a30efde0abd1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-507a2afa-83a7-4f54-bd89-a30efde0abd1" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:37 devstack cinder-volume[87051]: WARNING cinder.quota [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6942b8c-ef7d-453b-aad1-686516a233fa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Created reservations ['3a6e5b60-e4f7-40af-90d9-ab8dfc2c7222', 'a870d95c-2508-4cf4-8c6e-f7aba43e0271', '09c260ad-8eb4-4204-b940-f6124b1dbe3f', '5ad6ca97-9503-48ae-b58f-b413a3a5d57f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Delete snapshot completed successfully. Sep 02 16:24:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-562f1d05-e3d5-488d-a2ab-ee272eb923c0 tempest-VolumesExtendTest-88132966 None] Lock "cinder-7b89c277-05e7-43ef-b640-4b273c951a73-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:37 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:37 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-48abae9d-7f05-49a5-8e44-cc5d7d825674-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:38 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "cinder-48abae9d-7f05-49a5-8e44-cc5d7d825674-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.462s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:38 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1 Sep 02 16:24:38 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Acquiring lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc47482-b0f8-49ab-a58c-0b6eeb109ecc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:38 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:38 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:38 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-507a2afa-83a7-4f54-bd89-a30efde0abd1" returned: 0 in 0.297s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Lock "cinder-quobyte-507a2afa-83a7-4f54-bd89-a30efde0abd1" released by "delete_volume" :: held 0.835s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Created reservations ['fd4a43b2-3c16-4828-b7cf-56e2cc73f053'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Created reservations ['756a82dd-c052-4412-ad44-7eb0dc064993', '2914217c-0c41-495e-83de-c2db8b14bf4d', '0d4fa917-cb20-43cf-9d0a-3677f08e3a1b', '19f67c4d-0ee3-48c5-be05-c5da29e46232'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:38 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.412s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:38 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674 Sep 02 16:24:38 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:38 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:38 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:38 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-48abae9d-7f05-49a5-8e44-cc5d7d825674" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:38 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.351s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "cinder-quobyte-48abae9d-7f05-49a5-8e44-cc5d7d825674" released by "delete_volume" :: held 0.874s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1ac9d800-b8d9-4d12-9201-202f69db7df6 tempest-GroupsV314Test-1408423783 None] Delete group completed successfully. Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Created reservations ['5af0fe59-7136-4282-a3da-e171c4293073', 'a67543d6-3a08-43a7-b39f-db15d0fa5e1a', 'b29fb337-29d5-48f6-b8ac-b08d0bd1b493', '6bcf5d86-d20d-411e-95d7-1557020eb5cb'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:39 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:39 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:39 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.351s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Deleted volume successfully. Sep 02 16:24:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a033aca7-f0cb-4121-a5d0-7e69be905b20 tempest-VolumesExtendTest-88132966 None] Lock "cinder-48abae9d-7f05-49a5-8e44-cc5d7d825674-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (8fa1c352-f60b-45b0-9054-f8620f6f3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b68e4-55b3-48ae-8945-61dbdbcc793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b68e4-55b3-48ae-8945-61dbdbcc793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1570168313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5c9009-655f-4b2e-901a-dfa125df3b99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:45Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5446eced-ccd0-4409-af29-62373e143d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5446eced-ccd0-4409-af29-62373e143d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d89cf3-1c75-4ec9-a68d-f09520cf1616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d89cf3-1c75-4ec9-a68d-f09520cf1616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5c9009-655f-4b2e-901a-dfa125df3b99', 'volume_name': 'volume-2e5c9009-655f-4b2e-901a-dfa125df3b99', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d6173-141f-4121-b38f-67a7baece6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d6173-141f-4121-b38f-67a7baece6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ba645-1a80-49e4-93cf-56c4fbb983d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Volume 2e5c9009-655f-4b2e-901a-dfa125df3b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5c9009-655f-4b2e-901a-dfa125df3b99', 'volume_size': 1} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1570168313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5c9009-655f-4b2e-901a-dfa125df3b99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:45Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Creating volume 2e5c9009-655f-4b2e-901a-dfa125df3b99 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:45 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:45 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 1073741824 Sep 02 16:24:45 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (0f69904f-4730-4cb5-811d-054b031332e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f712231-da35-47f7-b655-653af416aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f712231-da35-47f7-b655-653af416aed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1739898781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301f7ba5-810d-437e-b1ff-8424f9d48424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:46Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2fbc89-0bbb-468a-b4d6-5fe729707e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2fbc89-0bbb-468a-b4d6-5fe729707e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2cb64-83bf-4f05-b5b7-a8fb9657f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2cb64-83bf-4f05-b5b7-a8fb9657f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301f7ba5-810d-437e-b1ff-8424f9d48424', 'volume_name': 'volume-301f7ba5-810d-437e-b1ff-8424f9d48424', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb4b783-5d6d-4745-96c0-2c7056e234be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb4b783-5d6d-4745-96c0-2c7056e234be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab2bd73-c8b2-4aab-99e4-0f515c4cbd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Volume 301f7ba5-810d-437e-b1ff-8424f9d48424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301f7ba5-810d-437e-b1ff-8424f9d48424', 'volume_size': 1} Sep 02 16:24:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:46 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 1073741824" returned: 0 in 0.651s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:46 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 Sep 02 16:24:46 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:46 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1739898781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301f7ba5-810d-437e-b1ff-8424f9d48424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eece2a5376674471a4a1f8d25bf45aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:46Z,use_quota=True,user_id='163793e67a7e413bbd55b6796e9f540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Creating volume 301f7ba5-810d-437e-b1ff-8424f9d48424 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:46 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ba645-1a80-49e4-93cf-56c4fbb983d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5c9009-655f-4b2e-901a-dfa125df3b99', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f2759b-a5ba-4152-9daa-4b6040595736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:46 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 1073741824 Sep 02 16:24:46 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:46 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Volume volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 (2e5c9009-655f-4b2e-901a-dfa125df3b99): created successfully Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f2759b-a5ba-4152-9daa-4b6040595736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (8fa1c352-f60b-45b0-9054-f8620f6f3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4b508d21-7d72-4198-98a6-bd0494548ea2 tempest-VolumesListTestJSON-916319018 None] Created volume successfully. Sep 02 16:24:47 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 1073741824" returned: 0 in 0.577s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:47 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 Sep 02 16:24:47 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Flow 'volume_create_manager' (52bd083f-b493-47c9-983a-5f4a62c8882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6edbace-fe11-4650-b693-33701b75c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6edbace-fe11-4650-b693-33701b75c991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2115745649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497ba0a4-6764-4a5f-ac1e-a6e273e3d8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10d3af2aed49c3b80d009f6c1425cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:47Z,use_quota=True,user_id='904d8ede14514cb68807901b16fede8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c20d99-b9d8-4334-a8d4-fd5603feb36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c20d99-b9d8-4334-a8d4-fd5603feb36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42605dde-ebc1-49e4-ac39-1d3255dea6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42605dde-ebc1-49e4-ac39-1d3255dea6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497ba0a4-6764-4a5f-ac1e-a6e273e3d8db', 'volume_name': 'volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8a72ee-47f8-4afd-babf-76f964c1276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8a72ee-47f8-4afd-babf-76f964c1276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dd3658-0db3-460c-bc84-a473fe750f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db', 'volume_size': 1} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:47 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424" returned: 0 in 0.437s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2115745649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497ba0a4-6764-4a5f-ac1e-a6e273e3d8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10d3af2aed49c3b80d009f6c1425cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:47Z,use_quota=True,user_id='904d8ede14514cb68807901b16fede8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Creating volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:47 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab2bd73-c8b2-4aab-99e4-0f515c4cbd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301f7ba5-810d-437e-b1ff-8424f9d48424', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db 1073741824 Sep 02 16:24:47 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553407a0-ae96-41a2-a986-6af055b832bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Volume volume-301f7ba5-810d-437e-b1ff-8424f9d48424 (301f7ba5-810d-437e-b1ff-8424f9d48424): created successfully Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553407a0-ae96-41a2-a986-6af055b832bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Flow 'volume_create_manager' (0f69904f-4730-4cb5-811d-054b031332e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0ccaebe6-629b-4938-9ef6-08845565c6e2 tempest-AttachVolumeNegativeTest-639539955 None] Created volume successfully. Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (da8b5582-4415-4ee5-a52f-cd418b21cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c476db-c3da-4b33-a268-629197430c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c476db-c3da-4b33-a268-629197430c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-6142303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78506a2-f8f3-4457-b1af-d41c1b003e1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:48Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6ad2e-e92b-449e-9be6-b5bcb37646d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6ad2e-e92b-449e-9be6-b5bcb37646d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b39ca96-d911-43e9-9927-2943588df385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b39ca96-d911-43e9-9927-2943588df385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78506a2-f8f3-4457-b1af-d41c1b003e1b', 'volume_name': 'volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11b1cfd-2527-4ecd-b91c-477496568c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11b1cfd-2527-4ecd-b91c-477496568c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8f6265-7e1a-49bd-9987-000a33443313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Volume c78506a2-f8f3-4457-b1af-d41c1b003e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b', 'volume_size': 1} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:48 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db 1073741824" returned: 0 in 0.881s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:48 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db Sep 02 16:24:48 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:48 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:48 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:49 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.413s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:24:49 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" returned: 0 in 0.635s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-6142303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78506a2-f8f3-4457-b1af-d41c1b003e1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:48Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Creating volume c78506a2-f8f3-4457-b1af-d41c1b003e1b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:49 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-72221a4b-cd84-4f02-a75b-d7719bdfc3f4 req-e5ac2a8d-51b7-4fa6-86d6-8558febb94bd tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:49 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b 1073741824 Sep 02 16:24:49 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dd3658-0db3-460c-bc84-a473fe750f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8c3c07-44ab-4ae0-ad51-acef1c4079a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:49 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Volume volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db (497ba0a4-6764-4a5f-ac1e-a6e273e3d8db): created successfully Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8c3c07-44ab-4ae0-ad51-acef1c4079a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Flow 'volume_create_manager' (52bd083f-b493-47c9-983a-5f4a62c8882d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cdf448cb-92e4-49f1-bd1b-49f76d997499 tempest-SnapshotsActionsTest-277765125 None] Created volume successfully. Sep 02 16:24:49 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b 1073741824" returned: 0 in 0.530s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:49 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b Sep 02 16:24:49 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:50 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b" returned: 0 in 0.242s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-72221a4b-cd84-4f02-a75b-d7719bdfc3f4 req-e5ac2a8d-51b7-4fa6-86d6-8558febb94bd tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.829s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8f6265-7e1a-49bd-9987-000a33443313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5012655-7a89-4c6c-a503-eacd117d2e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-72221a4b-cd84-4f02-a75b-d7719bdfc3f4 req-e5ac2a8d-51b7-4fa6-86d6-8558febb94bd tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Volume volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b (c78506a2-f8f3-4457-b1af-d41c1b003e1b): created successfully Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5012655-7a89-4c6c-a503-eacd117d2e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (da8b5582-4415-4ee5-a52f-cd418b21cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b9147ea9-3c77-4e08-9f21-92b1e0e358f5 tempest-VolumesListTestJSON-916319018 None] Created volume successfully. Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-72221a4b-cd84-4f02-a75b-d7719bdfc3f4 req-e5ac2a8d-51b7-4fa6-86d6-8558febb94bd tempest-AttachVolumeNegativeTest-639539955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-301f7ba5-810d-437e-b1ff-8424f9d48424', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d0f2707-be85-4096-b953-12a17a5661bd', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:24:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-72221a4b-cd84-4f02-a75b-d7719bdfc3f4 req-e5ac2a8d-51b7-4fa6-86d6-8558febb94bd tempest-AttachVolumeNegativeTest-639539955 None] attachment_update completed successfully. Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Creating offline snapshot 75e30bda-fdd2-48de-9264-357f82ea4e37 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca86ec-4e96-4f56-beb8-aa03876155aa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:50 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db Sep 02 16:24:50 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (3d07a7f0-bb37-422f-b6fc-7319282bad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ef6d80-5ac0-44c1-830f-0f6520800250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ef6d80-5ac0-44c1-830f-0f6520800250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1469554127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de150f2-a317-4600-a7b7-655548afad7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:51Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e9b6d6-8477-4d25-894b-d4977e51bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e9b6d6-8477-4d25-894b-d4977e51bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:51 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b0217e-3cf5-4072-b405-fa53d6c7956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b0217e-3cf5-4072-b405-fa53d6c7956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de150f2-a317-4600-a7b7-655548afad7f', 'volume_name': 'volume-2de150f2-a317-4600-a7b7-655548afad7f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c87b954-8831-4762-a6df-4c3442cb208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c87b954-8831-4762-a6df-4c3442cb208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a0915a-f3c5-4214-8227-c05fae21a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Volume 2de150f2-a317-4600-a7b7-655548afad7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de150f2-a317-4600-a7b7-655548afad7f', 'volume_size': 1} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" returned: 0 in 0.580s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:51 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 1G Sep 02 16:24:51 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:51 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 1G" returned: 0 in 0.396s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:51 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:24:51 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:51 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:51 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 is being set with open permissions: ugo+rw Sep 02 16:24:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:52 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:24:52 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:52 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:52 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info Sep 02 16:24:52 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:52 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:52 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info is being set with open permissions: ugo+rw Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:52 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info Sep 02 16:24:52 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:52 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-54550aad-9294-4385-ab58-bcd5faf96bf6 req-a26a8169-eb14-417d-aaba-d203b79ddb06 tempest-AttachVolumeNegativeTest-639539955 None] Terminate volume connection completed successfully. Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-54550aad-9294-4385-ab58-bcd5faf96bf6 req-a26a8169-eb14-417d-aaba-d203b79ddb06 tempest-AttachVolumeNegativeTest-639539955 None] Deleting attachment 0d0f2707-be85-4096-b953-12a17a5661bd. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:24:52 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.info" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1469554127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de150f2-a317-4600-a7b7-655548afad7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61914c93cc1440f597d524a0d7063350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:24:51Z,use_quota=True,user_id='0c779237ab50455faf0e1a1d034afe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Creating volume 2de150f2-a317-4600-a7b7-655548afad7f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:24:52 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:24:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-90a330d6-a028-4a77-ad1c-216b5e6e5bad tempest-SnapshotsActionsTest-277765125 None] Create snapshot completed successfully Sep 02 16:24:53 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f 1073741824 Sep 02 16:24:53 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:53 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f 1073741824" returned: 0 in 0.466s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:53 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f Sep 02 16:24:53 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:53 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a0915a-f3c5-4214-8227-c05fae21a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de150f2-a317-4600-a7b7-655548afad7f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5b7a3-3dc2-477f-93de-e65233c921b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:24:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Volume volume-2de150f2-a317-4600-a7b7-655548afad7f (2de150f2-a317-4600-a7b7-655548afad7f): created successfully Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5b7a3-3dc2-477f-93de-e65233c921b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:24:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Flow 'volume_create_manager' (3d07a7f0-bb37-422f-b6fc-7319282bad6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:24:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c5516ca1-4be9-4060-9ccd-7b51c3d45193 tempest-VolumesListTestJSON-916319018 None] Created volume successfully. Sep 02 16:24:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Creating offline snapshot 1ec6fb68-9079-4941-99dd-8aeae4288b48 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:24:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d8131-ce9c-4deb-9b44-37e716d6445d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:55 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:24:55 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:55 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.733s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:55 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 1G Sep 02 16:24:55 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:56 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 1G" returned: 0 in 0.643s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:56 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 Sep 02 16:24:56 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:56 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48" returned: 0 in 0.431s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:56 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 is being set with open permissions: ugo+rw Sep 02 16:24:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:56 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 Sep 02 16:24:56 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:57 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48" returned: 0 in 0.428s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f1d3a9f5-be1e-44ee-bd18-2ac0979c0b5f tempest-SnapshotsActionsTest-277765125 None] Create snapshot completed successfully Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-2de150f2-a317-4600-a7b7-655548afad7f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-2de150f2-a317-4600-a7b7-655548afad7f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-quobyte-2de150f2-a317-4600-a7b7-655548afad7f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-2de150f2-a317-4600-a7b7-655548afad7f" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570fbc7-a45f-482b-ae2f-0547674e3496]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:58 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f Sep 02 16:24:58 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-1ec6fb68-9079-4941-99dd-8aeae4288b48-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:58 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f" returned: 0 in 0.396s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-1ec6fb68-9079-4941-99dd-8aeae4288b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:58 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f Sep 02 16:24:58 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-1ec6fb68-9079-4941-99dd-8aeae4288b48" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-1ec6fb68-9079-4941-99dd-8aeae4288b48" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Deleting offline snapshot 1ec6fb68-9079-4941-99dd-8aeae4288b48 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] snapshot_file for this snap is: volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5f342-113e-439d-8109-dda3fa043ace]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:58 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 Sep 02 16:24:58 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:58 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2de150f2-a317-4600-a7b7-655548afad7f" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-2de150f2-a317-4600-a7b7-655548afad7f" released by "delete_volume" :: held 0.744s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Created reservations ['d63b46c8-4723-40a1-abda-c32f0e05a106', 'f3125cd7-afb7-4953-9331-e43c30fadc21', 'cad1cc0d-5f45-48db-adf5-d860b50199c1', '2cea495f-8a8d-4961-a955-22b33fc2739f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:58 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:24:58 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:58 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48" returned: 0 in 0.402s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a2dfd-a457-447f-9d7f-9f94b186ae27]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.308s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:24:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Deleted volume successfully. Sep 02 16:24:59 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:24:59 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-c78506a2-f8f3-4457-b1af-d41c1b003e1b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-301f7ba5-810d-437e-b1ff-8424f9d48424-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-301f7ba5-810d-437e-b1ff-8424f9d48424-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "cinder-c78506a2-f8f3-4457-b1af-d41c1b003e1b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c509d46d-262f-4681-8e96-4c72b0a5ccb3 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-2de150f2-a317-4600-a7b7-655548afad7f-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-quobyte-c78506a2-f8f3-4457-b1af-d41c1b003e1b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-quobyte-301f7ba5-810d-437e-b1ff-8424f9d48424" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-c78506a2-f8f3-4457-b1af-d41c1b003e1b" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf05f1-63ad-4855-9c82-fa33d38f7ce0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-301f7ba5-810d-437e-b1ff-8424f9d48424" acquired by "delete_volume" :: waited 0.047s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7d4b2-0ce9-42a2-b957-8c48573d2765]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b Sep 02 16:24:59 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 Sep 02 16:24:59 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.515s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 Sep 02 16:24:59 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b Sep 02 16:24:59 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424" returned: 0 in 0.391s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424 Sep 02 16:24:59 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48" returned: 0 in 0.386s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:24:59 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48 Sep 02 16:24:59 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:24:59 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c78506a2-f8f3-4457-b1af-d41c1b003e1b" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:24:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-c78506a2-f8f3-4457-b1af-d41c1b003e1b" released by "delete_volume" :: held 0.685s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Created reservations ['4a6f3400-f44f-40d2-b9b8-4e60378776e1', '41768831-fe9b-4c82-b5f8-06b2249258b2', 'f0d63fa9-e91c-4454-9564-1f8279a0df5a', '5e35e627-e72a-4ba4-bb88-9fd6908aa27f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-301f7ba5-810d-437e-b1ff-8424f9d48424" returned: 0 in 0.296s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-301f7ba5-810d-437e-b1ff-8424f9d48424" released by "delete_volume" :: held 0.741s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:00 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Created reservations ['7ae4bd38-a2bf-4b6a-8d10-9e7a03760e3e', 'd9f765d3-b945-4630-bca2-8ee4e61065a9', '3eb344d4-0ddb-4187-868d-c95eef1beba6', '13ba0b77-6260-49dc-9dae-1e76b981ef3a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:00 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:00 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.1ec6fb68-9079-4941-99dd-8aeae4288b48" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-1ec6fb68-9079-4941-99dd-8aeae4288b48" released by "_delete_snapshot" :: held 1.742s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_snapshot" :: held 1.775s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Created reservations ['5df01c84-13e1-4c29-9f1b-529e90a05fed', 'ae05c6c3-2cdd-492c-b4ce-80d0cb4670f2', 'b9228212-f1d5-4ccb-86a4-143b9feeb412', '11fe5e39-e32e-462b-9660-2bbada7537aa'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:00 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:00 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Delete snapshot completed successfully. Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-2e5c9009-655f-4b2e-901a-dfa125df3b99-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85709853-0ed2-4a54-9c3a-8fd999e2d37a tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-1ec6fb68-9079-4941-99dd-8aeae4288b48-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.337s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Deleted volume successfully. Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-2e5c9009-655f-4b2e-901a-dfa125df3b99-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-afb31fbc-bb04-4c18-916d-4929158b664e tempest-VolumesListTestJSON-916319018 None] Lock "cinder-c78506a2-f8f3-4457-b1af-d41c1b003e1b-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "cinder-quobyte-2e5c9009-655f-4b2e-901a-dfa125df3b99" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-3a5d7680-d699-45d8-9446-2437481f11d3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-2e5c9009-655f-4b2e-901a-dfa125df3b99" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-3a5d7680-d699-45d8-9446-2437481f11d3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40abf9-ff52-40a2-b891-e01acc56548f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:00 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Deleted volume successfully. Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-29445c54-8bfc-49d0-bda9-8e4bf906f258 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-301f7ba5-810d-437e-b1ff-8424f9d48424-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-quobyte-3a5d7680-d699-45d8-9446-2437481f11d3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-3a5d7680-d699-45d8-9446-2437481f11d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe800b28-72cd-4435-b7a3-478007eefdfe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:00 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 Sep 02 16:25:00 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:00 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 Sep 02 16:25:00 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Creating offline snapshot 40c2b213-f772-4d5b-bde0-fe3298b32e42 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcbcfec-ea13-41d7-9b26-73d070d95658]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99 Sep 02 16:25:01 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:01 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3 Sep 02 16:25:01 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2e5c9009-655f-4b2e-901a-dfa125df3b99" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-quobyte-2e5c9009-655f-4b2e-901a-dfa125df3b99" released by "delete_volume" :: held 0.784s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:01 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.411s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3a5d7680-d699-45d8-9446-2437481f11d3" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Created reservations ['ea19475d-8704-4c0a-9d1c-292a418eca76', '4cf70963-0ad4-4e58-b8ba-917451d172e9', '8bd7d0c6-98f9-4336-abdb-baadae203d23', 'dd0e70ad-b49f-4aa6-8fa7-b08e76763bb5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:01 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 1G Sep 02 16:25:01 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-3a5d7680-d699-45d8-9446-2437481f11d3" released by "delete_volume" :: held 0.721s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Created reservations ['7abd988d-a6b6-4ae5-b991-e54ea5329eda', 'a0554310-a41e-4fdc-ba85-5dcc4ce3ff36', 'bec2a5cc-5440-4483-a223-b94f1d8bedd4', '622a5116-4c00-4f02-b73d-803ec7579d6c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:01 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:01 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:01 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:01 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:01 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Deleted volume successfully. Sep 02 16:25:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fc5d9670-7ee0-4d32-ba17-e4d28dd8d505 tempest-VolumesListTestJSON-916319018 None] Lock "cinder-2e5c9009-655f-4b2e-901a-dfa125df3b99-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:02 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-eff36494-1afc-4c56-8193-1d86340d75e8-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 1G" returned: 0 in 0.620s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:02 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-eff36494-1afc-4c56-8193-1d86340d75e8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Deleted volume successfully. Sep 02 16:25:02 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 Sep 02 16:25:02 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b6d10341-b2d3-420a-8b94-7209f8f5ece9 tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-3a5d7680-d699-45d8-9446-2437481f11d3-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "cinder-quobyte-eff36494-1afc-4c56-8193-1d86340d75e8" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-eff36494-1afc-4c56-8193-1d86340d75e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2e914-f2ec-41a9-917c-1249fe0a9680]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:02 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 Sep 02 16:25:02 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:02 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42" returned: 0 in 0.375s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 is being set with open permissions: ugo+rw Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:02 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 Sep 02 16:25:02 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:02 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8" returned: 0 in 0.407s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:02 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8 Sep 02 16:25:02 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:02 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42" returned: 0 in 0.275s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7fc5d8eb-e9d3-4ccf-8e5b-7bdcdab349e4 tempest-SnapshotsActionsTest-277765125 None] Create snapshot completed successfully Sep 02 16:25:02 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-eff36494-1afc-4c56-8193-1d86340d75e8" returned: 0 in 0.277s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-quobyte-eff36494-1afc-4c56-8193-1d86340d75e8" released by "delete_volume" :: held 0.743s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:02 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Created reservations ['242d52fe-f6a0-43b3-82ee-55a064c313ad', '88f1b1d9-241c-4bfd-aef8-daa420b88e33', 'e70e5a82-2304-44fc-9c2d-d9ac2183acb1', '0eefc6b6-1eb0-4fcd-b864-f0eaf2d466ba'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:03 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:03 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-40c2b213-f772-4d5b-bde0-fe3298b32e42-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-40c2b213-f772-4d5b-bde0-fe3298b32e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-40c2b213-f772-4d5b-bde0-fe3298b32e42" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-40c2b213-f772-4d5b-bde0-fe3298b32e42" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Deleting offline snapshot 40c2b213-f772-4d5b-bde0-fe3298b32e42 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] snapshot_file for this snap is: volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[116cfe9f-01aa-4aaf-aa67-49a0bc9acdd3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:03 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.318s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Deleted volume successfully. Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8665279-1b90-4d56-969c-42c4143f80ea tempest-AttachVolumeNegativeTest-639539955 None] Lock "cinder-eff36494-1afc-4c56-8193-1d86340d75e8-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:03 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 Sep 02 16:25:03 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:03 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[65448efa-0b61-4620-924f-d610d3654f84]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:03 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:03 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:04 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.544s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:04 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 Sep 02 16:25:04 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:04 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42" returned: 0 in 0.481s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:04 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42 Sep 02 16:25:04 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:05 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.40c2b213-f772-4d5b-bde0-fe3298b32e42" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-40c2b213-f772-4d5b-bde0-fe3298b32e42" released by "_delete_snapshot" :: held 1.974s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_snapshot" :: held 2.027s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Flow 'volume_create_manager' (7a7f4c17-287c-46c8-9faa-11a4cebc9e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b716df0-a8ae-4bb4-bddb-1a6a9167b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b716df0-a8ae-4bb4-bddb-1a6a9167b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-295966840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66589efb-3ddb-4c3d-a4ab-507ba9eda479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c482eeec284d7c8209a14f4e9ce846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:05Z,use_quota=True,user_id='9e5ac18f7f0b44649c68b38d0312f01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf740f0-199e-4701-b2e4-d44627c52dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf740f0-199e-4701-b2e4-d44627c52dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cab2cd-46a7-4bc4-bafa-aa41af613172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cab2cd-46a7-4bc4-bafa-aa41af613172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66589efb-3ddb-4c3d-a4ab-507ba9eda479', 'volume_name': 'volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4faec-7406-4630-b4e2-a1434d57254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4faec-7406-4630-b4e2-a1434d57254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff59b47-96c3-4349-a213-38dc9c025e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479', 'volume_size': 1} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-295966840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66589efb-3ddb-4c3d-a4ab-507ba9eda479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c482eeec284d7c8209a14f4e9ce846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:05Z,use_quota=True,user_id='9e5ac18f7f0b44649c68b38d0312f01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Creating volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:05 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 1073741824 Sep 02 16:25:05 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Created reservations ['3b21e13b-e016-4446-935f-f2af948ab5e7', 'be6f75eb-fed9-49e4-a161-606cadbfab0f', '9728121b-7197-49df-ade0-e533f606b7d1', 'e769933d-2d44-4552-88fa-e661bc5757e0'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Delete snapshot completed successfully. Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a376c019-317e-4593-b392-de3393621a39 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-40c2b213-f772-4d5b-bde0-fe3298b32e42-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:05 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 1073741824" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:05 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 Sep 02 16:25:05 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:06 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479" returned: 0 in 0.277s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff59b47-96c3-4349-a213-38dc9c025e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4547630b-b51f-4533-b109-40cb730fa8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Volume volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 (66589efb-3ddb-4c3d-a4ab-507ba9eda479): created successfully Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4547630b-b51f-4533-b109-40cb730fa8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Flow 'volume_create_manager' (7a7f4c17-287c-46c8-9faa-11a4cebc9e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fcd3fcd1-776f-4ec8-af99-201b78d73437 tempest-VolumesSnapshotListTestJSON-580863992 None] Created volume successfully. Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Creating offline snapshot 9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4f254-6c64-45fe-8a6b-a6674ecd9497]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:06 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 Sep 02 16:25:06 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:06 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479" returned: 0 in 0.381s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:06 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d 1G Sep 02 16:25:06 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:07 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d 1G" returned: 0 in 0.485s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:07 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:07 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:07 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:07 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d is being set with open permissions: ugo+rw Sep 02 16:25:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:07 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:07 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:08 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:08 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info Sep 02 16:25:08 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:08 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info" returned: 0 in 0.268s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:08 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info is being set with open permissions: ugo+rw Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:08 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info Sep 02 16:25:08 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:08 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.info" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.939s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Creating offline snapshot fa192ca2-bf3c-46b3-9423-2d1f64017799 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9204819a-e8fc-4769-ad03-1834de4c9061 tempest-VolumesSnapshotListTestJSON-580863992 None] Create snapshot completed successfully Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c09cf04-0fab-478e-9235-184c22256e75]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:08 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:08 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:09 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:09 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 1G Sep 02 16:25:09 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (a30cfdd0-3268-4756-ba2f-410b771de6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c654872-c7fb-44d0-89d2-5a4efeb13c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c654872-c7fb-44d0-89d2-5a4efeb13c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-582344242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e6059-0ed1-405d-8d82-02940e7fa581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:09Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8a0549-527c-4910-a8f4-30f8d3943fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8a0549-527c-4910-a8f4-30f8d3943fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172a6e7e-9ec6-4db1-a0b3-5736d140f17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172a6e7e-9ec6-4db1-a0b3-5736d140f17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2e6059-0ed1-405d-8d82-02940e7fa581', 'volume_name': 'volume-0b2e6059-0ed1-405d-8d82-02940e7fa581', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb772ad0-84cf-4c98-9219-4e6b6ee50f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb772ad0-84cf-4c98-9219-4e6b6ee50f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6065be9-2f77-4574-9e1e-f36537cc61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:09 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Volume 0b2e6059-0ed1-405d-8d82-02940e7fa581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2e6059-0ed1-405d-8d82-02940e7fa581', 'volume_size': 1} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:09 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 1G" returned: 0 in 0.549s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:09 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 Sep 02 16:25:09 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:10 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:10 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 is being set with open permissions: ugo+rw Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:10 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 Sep 02 16:25:10 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:10 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.729s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-582344242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e6059-0ed1-405d-8d82-02940e7fa581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:09Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Creating volume 0b2e6059-0ed1-405d-8d82-02940e7fa581 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:10 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:10 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 1073741824 Sep 02 16:25:10 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:10 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a6eeba32-e245-422a-80a2-7732c34f9449 tempest-SnapshotsActionsTest-277765125 None] Create snapshot completed successfully Sep 02 16:25:10 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 1073741824" returned: 0 in 0.412s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:10 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 Sep 02 16:25:10 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-fa192ca2-bf3c-46b3-9423-2d1f64017799-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-fa192ca2-bf3c-46b3-9423-2d1f64017799-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:11 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.202s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-fa192ca2-bf3c-46b3-9423-2d1f64017799" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6065be9-2f77-4574-9e1e-f36537cc61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2e6059-0ed1-405d-8d82-02940e7fa581', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee0c805-7da8-4c38-9711-5a119fe4ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Creating offline snapshot 40660030-b439-4490-acae-591027216216 of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Volume volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 (0b2e6059-0ed1-405d-8d82-02940e7fa581): created successfully Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee0c805-7da8-4c38-9711-5a119fe4ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (a30cfdd0-3268-4756-ba2f-410b771de6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf43f4b-e581-4108-86bc-e89919d80abe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-fa192ca2-bf3c-46b3-9423-2d1f64017799" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Deleting offline snapshot fa192ca2-bf3c-46b3-9423-2d1f64017799 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] snapshot_file for this snap is: volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f607a63-4252-462c-a772-c668162362d6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-09baabc5-ae94-475a-b212-db1e5e026e6f tempest-AttachVolumeTestJSON-1412095487 None] Created volume successfully. Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:11 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:11 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Flow 'volume_create_manager' (3318f8ee-dc83-46cf-9cbb-15b9b7cf1d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348a035-27f4-4ba6-a889-4a5734e35590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 Sep 02 16:25:11 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348a035-27f4-4ba6-a889-4a5734e35590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1403518424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d51da-efb3-49c1-91d1-843159555744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d1efee0b30454c8a577103e98f4ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:11Z,use_quota=True,user_id='0007a89f1d9f49798d832c91424621ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489d99a-e71c-4e81-80e3-5ab1eb60f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489d99a-e71c-4e81-80e3-5ab1eb60f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56c6c75-5526-4936-bcc2-ecc528990aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56c6c75-5526-4936-bcc2-ecc528990aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0d51da-efb3-49c1-91d1-843159555744', 'volume_name': 'volume-3e0d51da-efb3-49c1-91d1-843159555744', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8217238-c7d4-4ac8-b157-d4c27fa6e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8217238-c7d4-4ac8-b157-d4c27fa6e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9712e-21ed-427a-8ec1-f0e294286312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Volume 3e0d51da-efb3-49c1-91d1-843159555744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0d51da-efb3-49c1-91d1-843159555744', 'volume_size': 1} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:11 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.424s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:11 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 1G Sep 02 16:25:11 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:11 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799" returned: 0 in 0.466s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f60b7a-83b4-44c7-9621-c61217673e22]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:11 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:11 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 1G" returned: 0 in 0.556s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:12 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.490s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:12 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:12 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 Sep 02 16:25:12 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0db99724-784e-4ff8-91a1-b208ea87941b req-e9f05faf-b38e-4209-a057-2637073e0757 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:12 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.315s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 is being set with open permissions: ugo+rw Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:12 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:12 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:12 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799 Sep 02 16:25:12 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.734s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1403518424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d51da-efb3-49c1-91d1-843159555744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d1efee0b30454c8a577103e98f4ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:11Z,use_quota=True,user_id='0007a89f1d9f49798d832c91424621ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Creating volume 3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:12 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:12 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 1073741824 Sep 02 16:25:12 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7b8b53b9-c3b5-4453-bfb2-22fbe0749778 tempest-VolumesSnapshotListTestJSON-580863992 None] Create snapshot completed successfully Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=148,cinder:INSERT=33,cinder:UPDATE=155,cinder:DELETE=14 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:25:12 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.fa192ca2-bf3c-46b3-9423-2d1f64017799" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-fa192ca2-bf3c-46b3-9423-2d1f64017799" released by "_delete_snapshot" :: held 1.728s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_snapshot" :: held 1.830s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:12 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=129,cinder:INSERT=47,cinder:UPDATE=147,cinder:DELETE=11 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Created reservations ['03dd8e5e-c9d4-4d05-a3f8-7aceca160b39', '85efacb7-36cb-4a67-acf4-026c3da24771', 'ae9003f6-f6e0-4ebe-99fc-09186b24c6c4', '7b31e747-19a1-47e4-917d-02864691f651'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Delete snapshot completed successfully. Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df22f967-679b-481e-ad5c-31d355710692 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-fa192ca2-bf3c-46b3-9423-2d1f64017799-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:13 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 1073741824" returned: 0 in 0.482s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:13 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 Sep 02 16:25:13 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:13 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0db99724-784e-4ff8-91a1-b208ea87941b req-e9f05faf-b38e-4209-a057-2637073e0757 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.097s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0db99724-784e-4ff8-91a1-b208ea87941b req-e9f05faf-b38e-4209-a057-2637073e0757 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.084s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.422s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9712e-21ed-427a-8ec1-f0e294286312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0d51da-efb3-49c1-91d1-843159555744', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a3249-9ad3-430f-8af1-2f412426c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Volume volume-3e0d51da-efb3-49c1-91d1-843159555744 (3e0d51da-efb3-49c1-91d1-843159555744): created successfully Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a3249-9ad3-430f-8af1-2f412426c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Flow 'volume_create_manager' (3318f8ee-dc83-46cf-9cbb-15b9b7cf1d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Creating offline snapshot 567c6bf8-a4a4-4130-91fe-a89a45bba99a of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-0db99724-784e-4ff8-91a1-b208ea87941b req-e9f05faf-b38e-4209-a057-2637073e0757 tempest-AttachVolumeTestJSON-1412095487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-0b2e6059-0ed1-405d-8d82-02940e7fa581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '466177fa-d862-4ae7-acb8-6612701df4e2', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33fa18-af92-4984-bf0d-3c27a465dbde]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-7b64bf82-2251-483c-96de-a16af3199d4b req-d40a6ea9-8241-49fb-a70e-ca676a7f3d37 tempest-VolumesSnapshotsTestJSON-1076672087 None] Created volume successfully. Sep 02 16:25:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-0db99724-784e-4ff8-91a1-b208ea87941b req-e9f05faf-b38e-4209-a057-2637073e0757 tempest-AttachVolumeTestJSON-1412095487 None] attachment_update completed successfully. Sep 02 16:25:13 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:13 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:14 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:14 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a 1G Sep 02 16:25:14 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:14 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a 1G" returned: 0 in 0.611s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:14 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a Sep 02 16:25:14 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:15 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a" returned: 0 in 0.321s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:15 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a is being set with open permissions: ugo+rw Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:15 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a Sep 02 16:25:15 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:15 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.689s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Creating offline snapshot 80394559-957d-48af-9516-454d1b21e656 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e6ca0382-398c-40b9-aa27-fe03321e834b tempest-VolumesSnapshotListTestJSON-580863992 None] Create snapshot completed successfully Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[24498884-4786-4f5c-ad22-0110f4bfc02d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:15 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:15 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:15 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:16 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 1G Sep 02 16:25:16 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (706256ab-d84b-494a-9c4a-8f6a97726f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f301cee-9a84-4c65-bd13-cbd7d77936c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f301cee-9a84-4c65-bd13-cbd7d77936c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-824679094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3154f0ef-d823-433c-9165-f0667912c480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:16Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb133ae-5293-479e-b0db-226dd403f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb133ae-5293-479e-b0db-226dd403f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8935bcb0-b4ae-4d4c-8c0d-84a6f2a15c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8935bcb0-b4ae-4d4c-8c0d-84a6f2a15c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3154f0ef-d823-433c-9165-f0667912c480', 'volume_name': 'volume-3154f0ef-d823-433c-9165-f0667912c480', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d81e1c-14b9-473d-8484-3d258e872ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d81e1c-14b9-473d-8484-3d258e872ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23430027-a042-4d87-9352-f4d78ae72916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Volume 3154f0ef-d823-433c-9165-f0667912c480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3154f0ef-d823-433c-9165-f0667912c480', 'volume_size': 1} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:16 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 1G" returned: 0 in 0.427s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:16 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 Sep 02 16:25:16 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:16 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656" returned: 0 in 0.292s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:16 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 is being set with open permissions: ugo+rw Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:16 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 Sep 02 16:25:16 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:16 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.456s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.961s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Creating offline snapshot 6af290ba-d946-4df7-b957-e813ea68ea53 of volume 3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-771b9bf0-6c35-4e3d-b6a9-b88ee917ecd8 tempest-SnapshotsActionsTest-277765125 None] Create snapshot completed successfully Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80e7b8-b5fa-456e-ad2f-486560735fb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:17 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 Sep 02 16:25:17 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-567c6bf8-a4a4-4130-91fe-a89a45bba99a-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-567c6bf8-a4a4-4130-91fe-a89a45bba99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-567c6bf8-a4a4-4130-91fe-a89a45bba99a" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-567c6bf8-a4a4-4130-91fe-a89a45bba99a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Deleting offline snapshot 567c6bf8-a4a4-4130-91fe-a89a45bba99a of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] snapshot_file for this snap is: volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6db24-1a3b-4b03-bda9-6de33ccd8723]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:17 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744" returned: 0 in 0.401s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:17 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a Sep 02 16:25:17 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:17 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 1G Sep 02 16:25:17 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:17 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711bca2-6a97-45d6-bc8a-3f7eb129f8b3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:17 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:17 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:17 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 1G" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0d51da-efb3-49c1-91d1-843159555744 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:17 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0d51da-efb3-49c1-91d1-843159555744 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 Sep 02 16:25:17 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-80394559-957d-48af-9516-454d1b21e656-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-80394559-957d-48af-9516-454d1b21e656-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Acquiring lock "cinder-quobyte-80394559-957d-48af-9516-454d1b21e656" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-80394559-957d-48af-9516-454d1b21e656" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Deleting offline snapshot 80394559-957d-48af-9516-454d1b21e656 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] snapshot_file for this snap is: volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b9bee-146d-415c-b914-e110f650b797]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a Sep 02 16:25:18 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 Sep 02 16:25:18 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0d51da-efb3-49c1-91d1-843159555744 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 is being set with open permissions: ugo+rw Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 Sep 02 16:25:18 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3e869a-acc7-466a-85e0-061d87591a4d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a" returned: 0 in 0.459s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info Sep 02 16:25:18 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:18 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a Sep 02 16:25:18 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info is being set with open permissions: ugo+rw Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.567c6bf8-a4a4-4130-91fe-a89a45bba99a" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info Sep 02 16:25:18 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:18 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.421s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-567c6bf8-a4a4-4130-91fe-a89a45bba99a" released by "_delete_snapshot" :: held 1.628s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" released by "delete_snapshot" :: held 1.664s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:18 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 Sep 02 16:25:18 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Created reservations ['bfb658f7-35d9-4fc4-aded-ace10fb28fdb', '5468873c-90ac-408a-a55b-5f2ca1d0d8b2', 'b6f848a7-412c-4705-81df-1a05b8dfeb8b', 'e4dd77df-660c-46c4-a745-ac20c556f4b0'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Delete snapshot completed successfully. Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fda31217-109e-40f6-a0f2-b22e546feeb5 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-567c6bf8-a4a4-4130-91fe-a89a45bba99a-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:19 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.info" returned: 0 in 0.327s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-824679094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3154f0ef-d823-433c-9165-f0667912c480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed513e32944c21bbc33855da144368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:16Z,use_quota=True,user_id='7db930aa03454853bc86a10370e2a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Creating volume 3154f0ef-d823-433c-9165-f0667912c480 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:19 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:19 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 1073741824 Sep 02 16:25:19 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-ad1b08cc-74f6-4794-b46f-9ed98308c79e req-e8fffee3-d170-483b-af14-eb1dd8694114 tempest-VolumesSnapshotsTestJSON-1076672087 None] Create snapshot completed successfully Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-40660030-b439-4490-acae-591027216216-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656" returned: 0 in 0.521s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-40660030-b439-4490-acae-591027216216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656 Sep 02 16:25:19 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-40660030-b439-4490-acae-591027216216" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-40660030-b439-4490-acae-591027216216" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Deleting offline snapshot 40660030-b439-4490-acae-591027216216 of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] snapshot_file for this snap is: volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030edcb-0c4d-4bc5-b2d1-40492fd0b2b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "cinder-6af290ba-d946-4df7-b957-e813ea68ea53-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-6af290ba-d946-4df7-b957-e813ea68ea53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "cinder-quobyte-6af290ba-d946-4df7-b957-e813ea68ea53" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-6af290ba-d946-4df7-b957-e813ea68ea53" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Deleting offline snapshot 6af290ba-d946-4df7-b957-e813ea68ea53 of volume 3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:19 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:19 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:19 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] snapshot_file for this snap is: volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.80394559-957d-48af-9516-454d1b21e656" returned: 0 in 0.390s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8063585-6305-47cb-bae3-f85f44835cad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:19 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 1073741824" returned: 0 in 0.655s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-80394559-957d-48af-9516-454d1b21e656" released by "_delete_snapshot" :: held 1.889s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_snapshot" :: held 1.929s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:19 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 Sep 02 16:25:19 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 Sep 02 16:25:20 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Created reservations ['b19404d9-7796-4a77-97a9-860a1fc5f4e3', '09743890-6527-4bcb-bb73-a73eb08b775e', '7058ba3e-9238-4732-8482-2050ad2ffb8f', '3e43f6e9-8631-4705-b70b-5a1ec4da1bba'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Delete snapshot completed successfully. Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a5ad8928-dafd-4ebc-8f66-8fe054e5d9f7 tempest-SnapshotsActionsTest-748147536 None] Lock "cinder-80394559-957d-48af-9516-454d1b21e656-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:20 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.608s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[79962187-cee4-4755-95c0-e4ff600fdd86]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:20 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480" returned: 0 in 0.340s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23430027-a042-4d87-9352-f4d78ae72916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3154f0ef-d823-433c-9165-f0667912c480', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f218c856-9da7-41d0-8576-1e850a1957d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:20 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Volume volume-3154f0ef-d823-433c-9165-f0667912c480 (3154f0ef-d823-433c-9165-f0667912c480): created successfully Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f218c856-9da7-41d0-8576-1e850a1957d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Flow 'volume_create_manager' (706256ab-d84b-494a-9c4a-8f6a97726f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:20 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53" returned: 0 in 0.508s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e0d51da-efb3-49c1-91d1-843159555744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:20 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:20 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2b1b76d8-54a2-4564-a976-87d3903333a3 tempest-AttachVolumeTestJSON-1412095487 None] Created volume successfully. Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dbc6d-6f4f-439c-ba4a-a6f94072585f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:20 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 Sep 02 16:25:20 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "cinder-75e30bda-fdd2-48de-9264-357f82ea4e37-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-75e30bda-fdd2-48de-9264-357f82ea4e37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "cinder-quobyte-75e30bda-fdd2-48de-9264-357f82ea4e37" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-75e30bda-fdd2-48de-9264-357f82ea4e37" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Deleting offline snapshot 75e30bda-fdd2-48de-9264-357f82ea4e37 of volume 497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:20 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] snapshot_file for this snap is: volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.497s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1e172c-f6e5-4084-88c2-28fb94515633]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:20 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:20 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:20 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 Sep 02 16:25:20 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:20 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:20 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:21 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.409s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5928675-be12-4dce-9a6b-0ae44452a963]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:21 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216 Sep 02 16:25:21 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53" returned: 0 in 0.372s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:21 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53 Sep 02 16:25:21 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:21 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db Sep 02 16:25:21 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:21 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.40660030-b439-4490-acae-591027216216" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-40660030-b439-4490-acae-591027216216" released by "_delete_snapshot" :: held 1.941s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" released by "delete_snapshot" :: held 1.971s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744.6af290ba-d946-4df7-b957-e813ea68ea53" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-6af290ba-d946-4df7-b957-e813ea68ea53" released by "_delete_snapshot" :: held 1.740s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" released by "delete_snapshot" :: held 1.795s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Created reservations ['fcde5fed-e194-44c9-a379-967c8559e1a3', 'ac8820ce-db4e-44bc-905a-9623ef8b3543', 'c3e2c4ba-cfbd-4de3-aef4-b5a76bedf0b9', '7d71d029-6556-499e-b645-9d06855d689e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:21 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:21 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.quota [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Created reservations ['74b3a817-38da-48ec-9a60-e854a5b7518d', '42244bf8-2c90-43a5-9d99-da9c715ce43c', '0fb07fc4-5ad2-4b3b-8d92-fabd7bdce398', 'bfa4d1f7-4801-4b13-9aec-a40e63f09d7e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Delete snapshot completed successfully. Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8a16e8d4-89c0-480c-b8a1-8067d8674353 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-40660030-b439-4490-acae-591027216216-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Delete snapshot completed successfully. Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-067e201d-87da-4a02-bab6-fe5cf615debd req-0674f7a4-7b97-4a0c-958c-6c106103a85e tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-6af290ba-d946-4df7-b957-e813ea68ea53-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "cinder-3e0d51da-efb3-49c1-91d1-843159555744-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-3e0d51da-efb3-49c1-91d1-843159555744-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:22 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.511s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[98736f2f-38c7-4c6f-bb27-fd8865292f48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:22 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37 Sep 02 16:25:22 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:22 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 Sep 02 16:25:22 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-07f41358-7a73-4523-a52c-e58f7cd2126f req-cb5b2fe6-199e-4e90-8843-c9a48a6bd084 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-07f41358-7a73-4523-a52c-e58f7cd2126f req-cb5b2fe6-199e-4e90-8843-c9a48a6bd084 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-07f41358-7a73-4523-a52c-e58f7cd2126f req-cb5b2fe6-199e-4e90-8843-c9a48a6bd084 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-07f41358-7a73-4523-a52c-e58f7cd2126f req-cb5b2fe6-199e-4e90-8843-c9a48a6bd084 tempest-AttachVolumeTestJSON-1412095487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-3154f0ef-d823-433c-9165-f0667912c480', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38e0aed7-0c4b-44c1-bb87-12fc3dc2507f', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:25:22 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db.75e30bda-fdd2-48de-9264-357f82ea4e37" returned: 0 in 0.271s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-75e30bda-fdd2-48de-9264-357f82ea4e37" released by "_delete_snapshot" :: held 1.721s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_snapshot" :: held 1.749s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-07f41358-7a73-4523-a52c-e58f7cd2126f req-cb5b2fe6-199e-4e90-8843-c9a48a6bd084 tempest-AttachVolumeTestJSON-1412095487 None] attachment_update completed successfully. Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Created reservations ['17fde003-3f2f-431c-aa99-8443dd398c0f', 'ba130047-17bf-41f0-9fdb-3b1af4da7bdf', 'ac5bdf96-a2f7-4556-bfc0-0d2254c9da30', '8d854360-4c6d-42e9-aac1-0232e8cca305'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:22 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:22 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744 Sep 02 16:25:22 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Delete snapshot completed successfully. Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-381515a5-cbdb-480b-9e84-f5b0286dd85e tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-75e30bda-fdd2-48de-9264-357f82ea4e37-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Deleting offline snapshot 9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d of volume 66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] snapshot_file for this snap is: volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef1083-2425-473e-8a6d-bd4e4a4f0d40]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:22 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3e0d51da-efb3-49c1-91d1-843159555744" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-quobyte-3e0d51da-efb3-49c1-91d1-843159555744" released by "delete_volume" :: held 0.838s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:22 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:22 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "cinder-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:22 devstack cinder-volume[87051]: DEBUG cinder.quota [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Created reservations ['645928fb-6d82-4baa-ad70-6310e62e4134', 'ef3a76c7-e621-457e-8c51-043d7c4779d5', '69f5fea4-a7ae-475d-b255-d447dfe57976', '876a1510-edea-4bef-82f9-5ce56dfe5a98'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500c368-440a-48e6-8950-d148504203ab]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:23 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:23 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:23 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.495s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b00c5-f699-4f0a-b916-eefc86e49057]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:23 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db Sep 02 16:25:23 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:23 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 Sep 02 16:25:23 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:23 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.330s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.manager [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Deleted volume successfully. Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-39680c74-bc0e-4b67-852b-e398da556417 req-38877703-0c0e-4f94-b4a5-b1586e30e328 tempest-VolumesSnapshotsTestJSON-1076672087 None] Lock "cinder-3e0d51da-efb3-49c1-91d1-843159555744-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:23 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" returned: 0 in 0.499s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:23 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db Sep 02 16:25:23 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:23 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479" returned: 0 in 0.542s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:23 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:23 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:24 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-quobyte-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db" released by "delete_volume" :: held 0.914s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Created reservations ['2d8900d9-1dc3-4048-9587-ab82f76cdb8b', '6505d187-df82-4f67-8e41-27f5621a4d9d', '5fff9b00-f82a-4ff8-9c16-ca6d6c8eda18', '53027571-6e1a-4c9c-b477-90feb6722226'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:24 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:24 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-2b5085e7-3a9c-4ea3-881d-eeac7a711a46 req-bb88cf38-5282-418d-b15b-04de2fd0ceb8 tempest-AttachVolumeTestJSON-1412095487 None] Terminate volume connection completed successfully. Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-2b5085e7-3a9c-4ea3-881d-eeac7a711a46 req-bb88cf38-5282-418d-b15b-04de2fd0ceb8 tempest-AttachVolumeTestJSON-1412095487 None] Deleting attachment 466177fa-d862-4ae7-acb8-6612701df4e2. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:25:24 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.538s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:24 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d Sep 02 16:25:24 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:24 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.348s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Deleted volume successfully. Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-960749e3-634e-4b3e-af5f-86c3149157c6 tempest-SnapshotsActionsTest-277765125 None] Lock "cinder-497ba0a4-6764-4a5f-ac1e-a6e273e3d8db-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:24 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479.9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d" released by "_delete_snapshot" :: held 2.016s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" released by "delete_snapshot" :: held 2.044s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Created reservations ['30743382-5f95-4cd9-8e43-e93385a7bbf6', '8ad57120-abea-477c-9c21-fd0c3e6fe20a', 'd3b2034d-f349-4b05-a2fc-63a945b4c1a8', 'a2256419-90e0-43d4-97bb-5dd5d305e7c9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Delete snapshot completed successfully. Sep 02 16:25:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9a287eee-7efc-494e-90cd-925a6f71ea6d tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-9e8bf1ee-1f15-45e1-8ac3-193d75c5ee0d-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-3fb03552-4b2d-4ed7-a377-eab92883db3a req-d2887de6-d7f8-4602-af6b-8bc419ae4a8d tempest-AttachVolumeTestJSON-1412095487 None] Terminate volume connection completed successfully. Sep 02 16:25:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-3fb03552-4b2d-4ed7-a377-eab92883db3a req-d2887de6-d7f8-4602-af6b-8bc419ae4a8d tempest-AttachVolumeTestJSON-1412095487 None] Deleting attachment 38e0aed7-0c4b-44c1-bb87-12fc3dc2507f. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-66589efb-3ddb-4c3d-a4ab-507ba9eda479-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-66589efb-3ddb-4c3d-a4ab-507ba9eda479-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157ded1-a6e5-4445-ad16-e24de50d524b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:26 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 Sep 02 16:25:26 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:26 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:26 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479 Sep 02 16:25:26 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:26 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-66589efb-3ddb-4c3d-a4ab-507ba9eda479" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-quobyte-66589efb-3ddb-4c3d-a4ab-507ba9eda479" released by "delete_volume" :: held 0.856s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Created reservations ['bf02cc1b-a18b-46a6-af44-6c9f719ccf9e', '8acd2079-b668-4c5c-9d8c-f068c1f531d6', '5c11801b-f6a1-42e6-ae19-4d7d820003b5', '219c5784-f61e-4771-b6ec-4e4400fd6ca1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:27 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:27 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:27 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.365s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Deleted volume successfully. Sep 02 16:25:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae81dd95-d5d8-49d9-bcf8-bab228339743 tempest-VolumesSnapshotListTestJSON-580863992 None] Lock "cinder-66589efb-3ddb-4c3d-a4ab-507ba9eda479-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-814f215a-1dbc-4a18-93ab-b02343acc559 tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1942334159: creating Sep 02 16:25:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-814f215a-1dbc-4a18-93ab-b02343acc559 tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1942334159: created successfully Sep 02 16:25:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-814f215a-1dbc-4a18-93ab-b02343acc559 tempest-GroupSnapshotsTest-1835411034 None] Create group completed successfully. Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (548c0323-fa11-4b48-a9b8-dfd6460d42fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592e9097-5c54-4d64-ad0a-f4a8345f192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592e9097-5c54-4d64-ad0a-f4a8345f192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587203011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24cf0367-53ad-4afc-86fe-e4d3db2698d4,host='devstack@QuobyteHD#QuobyteHD',id=342ad230-fbff-4915-bc84-d061ea809c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:31Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c41865-7140-4c36-82b1-df0ddcf3d10d),volume_type_id=b0c41865-7140-4c36-82b1-df0ddcf3d10d)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b30717-24cb-486c-b6a8-ce89bb159ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b30717-24cb-486c-b6a8-ce89bb159ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6390c5-1658-409a-b957-591b27666eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6390c5-1658-409a-b957-591b27666eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342ad230-fbff-4915-bc84-d061ea809c0b', 'volume_name': 'volume-342ad230-fbff-4915-bc84-d061ea809c0b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc7f6dc-ca69-491d-b3ce-cb2612f6d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc7f6dc-ca69-491d-b3ce-cb2612f6d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9ce990-a594-4622-a3fc-e046ff90c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Volume 342ad230-fbff-4915-bc84-d061ea809c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342ad230-fbff-4915-bc84-d061ea809c0b', 'volume_size': 1} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24cf0367-53ad-4afc-86fe-e4d3db2698d4,created_at=2026-09-02T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587203011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24cf0367-53ad-4afc-86fe-e4d3db2698d4,host='devstack@QuobyteHD#QuobyteHD',id=342ad230-fbff-4915-bc84-d061ea809c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:31Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c41865-7140-4c36-82b1-df0ddcf3d10d),volume_type_id=b0c41865-7140-4c36-82b1-df0ddcf3d10d)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Creating volume 342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:31 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:31 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b 1073741824 Sep 02 16:25:31 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:31 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b 1073741824" returned: 0 in 0.503s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:31 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:31 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:31 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.281s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9ce990-a594-4622-a3fc-e046ff90c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342ad230-fbff-4915-bc84-d061ea809c0b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fe48df-1470-4fb2-9701-2748f7bb2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:32 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Volume volume-342ad230-fbff-4915-bc84-d061ea809c0b (342ad230-fbff-4915-bc84-d061ea809c0b): created successfully Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fe48df-1470-4fb2-9701-2748f7bb2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (548c0323-fa11-4b48-a9b8-dfd6460d42fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0deb22dc-2406-49c2-9842-2fba31f1545e tempest-GroupSnapshotsTest-1835411034 None] Created volume successfully. Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-3154f0ef-d823-433c-9165-f0667912c480-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-3154f0ef-d823-433c-9165-f0667912c480-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-quobyte-3154f0ef-d823-433c-9165-f0667912c480" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-3154f0ef-d823-433c-9165-f0667912c480" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10776c80-5bd3-4583-bf7e-8acf54b24d69]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:32 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 Sep 02 16:25:32 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] GroupSnapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: creating. Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Group snapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: creating. {{(pid=87051) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Creating offline snapshot 9f4840d1-abb5-4935-baeb-a97aa3c49eb4 of volume 342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccf7110-987f-4b89-87a8-21f23c3296ba]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:32 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480" returned: 0 in 0.651s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:32 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480 Sep 02 16:25:32 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:33 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:33 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:33 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3154f0ef-d823-433c-9165-f0667912c480" returned: 0 in 0.448s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-3154f0ef-d823-433c-9165-f0667912c480" released by "delete_volume" :: held 1.170s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Created reservations ['c6ebd7cf-907c-4163-80e0-8990ac910ec7', '9103c151-21f8-4f8d-8410-ed9ebcbb837d', '5e36f773-e93f-47d4-96f8-f6a2c8f488f3', 'aeeb7419-66c8-483a-ba08-87a81da6fe69'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:33 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.706s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:33 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 1G Sep 02 16:25:33 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:33 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:33 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:33 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.306s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Deleted volume successfully. Sep 02 16:25:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86e12ee9-f756-4340-af74-7dd189cfb823 tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-3154f0ef-d823-433c-9165-f0667912c480-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:34 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 1G" returned: 0 in 0.620s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342ad230-fbff-4915-bc84-d061ea809c0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:34 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342ad230-fbff-4915-bc84-d061ea809c0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:34 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-0b2e6059-0ed1-405d-8d82-02940e7fa581-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-0b2e6059-0ed1-405d-8d82-02940e7fa581-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-quobyte-0b2e6059-0ed1-405d-8d82-02940e7fa581" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-0b2e6059-0ed1-405d-8d82-02940e7fa581" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad774a-421c-4bcc-922a-c424167afec6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:34 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342ad230-fbff-4915-bc84-d061ea809c0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.461s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:34 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:34 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:34 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:34 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 Sep 02 16:25:34 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:34 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:35 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info Sep 02 16:25:35 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:35 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581" returned: 0 in 0.470s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:35 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581 Sep 02 16:25:35 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:35 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:35 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:35 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info Sep 02 16:25:35 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:35 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0b2e6059-0ed1-405d-8d82-02940e7fa581" returned: 0 in 0.395s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-0b2e6059-0ed1-405d-8d82-02940e7fa581" released by "delete_volume" :: held 0.918s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Created reservations ['e75976f8-0d71-4c32-853b-deaafe649976', '0e1fef71-dc6a-4918-81d4-d3a6bf4a5308', '083b1cb2-1935-4168-82c0-422fec54cb5b', '3cbbffdb-4d96-4fba-bd4a-13996dab4d23'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:35 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:35 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.info" returned: 0 in 0.340s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:35 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-41430f2c-b262-45e8-9888-61aabd32b19f tempest-GroupSnapshotsTest-1835411034 None] group_snapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: created successfully Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-7b12352c-6ea7-45dd-a587-aade63a3d8cd-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-7b12352c-6ea7-45dd-a587-aade63a3d8cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "cinder-quobyte-7b12352c-6ea7-45dd-a587-aade63a3d8cd" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-7b12352c-6ea7-45dd-a587-aade63a3d8cd" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[988925be-c075-4dd6-bf7a-8431ff307cbc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:36 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.479s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Deleted volume successfully. Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d20ece7-933d-466c-ae75-e7015c24976c tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-0b2e6059-0ed1-405d-8d82-02940e7fa581-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:36 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd Sep 02 16:25:36 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:36 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd" returned: 0 in 0.516s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:36 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd Sep 02 16:25:36 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4-08280476-1955-4597-9323-3478f1fce2e1" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4-08280476-1955-4597-9323-3478f1fce2e1" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Creating volume 08280476-1955-4597-9323-3478f1fce2e1 from snapshot 9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:36 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7b12352c-6ea7-45dd-a587-aade63a3d8cd" returned: 0 in 0.388s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-quobyte-7b12352c-6ea7-45dd-a587-aade63a3d8cd" released by "delete_volume" :: held 0.987s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] snapshot: 9f4840d1-abb5-4935-baeb-a97aa3c49eb4, volume: 08280476-1955-4597-9323-3478f1fce2e1, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2754aa-dce2-42d7-aa87-1254c51edc17]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Created reservations ['ca4e679c-1425-4bed-b60d-7c596213cb80', '2033d7f6-9c60-48e9-945a-20f6d67cb4df', '72c9f014-52ad-447f-a9e8-fe9cded5beab', '23edbf72-9917-424f-abc0-cee066e7f00f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:37 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:37 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:37 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:37 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:37 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Deleted volume successfully. Sep 02 16:25:37 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.512s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342ad230-fbff-4915-bc84-d061ea809c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6562f5-9aec-4d4f-9ab7-d90e07d17865]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4f7a6318-b5e9-463d-a7b1-1c22cc1b1a3f tempest-AttachVolumeTestJSON-1412095487 None] Lock "cinder-7b12352c-6ea7-45dd-a587-aade63a3d8cd-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:37 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:37 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:37 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:25:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:25:38 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:25:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:38 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 Sep 02 16:25:38 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:44 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1" returned: 0 in 6.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:25:44 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Converted 1024.00 MB image at 161.03 MB/s Sep 02 16:25:44 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:44 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 Sep 02 16:25:44 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:44 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1" returned: 0 in 0.359s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" released by "_copy_volume_from_snapshot" :: held 7.750s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4-08280476-1955-4597-9323-3478f1fce2e1" released by "_create_volume_from_snapshot" :: held 7.846s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.872s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-85b02d10-b3a6-4551-938c-63b3ded6d8e9 tempest-GroupSnapshotsTest-1835411034 None] Create group from source-snapshot-b5c7d2c3-b1d1-45ed-83f2-7baeea079aed completed successfully. Sep 02 16:25:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b675d13-81c1-4303-b572-f898113136a1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:46 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 Sep 02 16:25:46 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:46 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1" returned: 0 in 0.428s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:46 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1 Sep 02 16:25:46 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:46 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-08280476-1955-4597-9323-3478f1fce2e1" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-08280476-1955-4597-9323-3478f1fce2e1" released by "delete_volume" :: held 0.914s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['6cfbdbe7-9f54-457d-822b-b851fe01c392'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:46 devstack cinder-volume[87051]: WARNING cinder.quota [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-931633886 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-931633886, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:25:46 devstack cinder-volume[87051]: WARNING cinder.quota [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-931633886 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-931633886, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:25:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['666bdb74-63a3-4bfe-8945-a0799cdd5e56', '30b2a76d-dfee-4f4e-b33b-24d62e357194', '50ab204d-b5b4-4c4d-ad9a-6199f98ff2dd', '4110f2c2-219a-4ce7-a57d-5686cbdc8198'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:47 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:47 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] group_snapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: deleting Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] group_snapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: deleting {{(pid=87051) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Deleting offline snapshot 9f4840d1-abb5-4935-baeb-a97aa3c49eb4 of volume 342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] snapshot_file for this snap is: volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:25:47 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[163d0b7f-394e-4f05-bab5-59fdf4eb7f0a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.422s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:47 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c1863cf9-a6a2-46a4-8f42-ac60bb518b2d tempest-GroupSnapshotsTest-1835411034 None] Delete group completed successfully. Sep 02 16:25:47 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:47 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:48 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.515s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342ad230-fbff-4915-bc84-d061ea809c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d503e6-c007-43a3-a096-df5341afa222]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:48 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:48 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:48 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:48 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:48 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.654s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:48 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:48 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:48 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:25:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:25:49 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.490s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:49 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4 Sep 02 16:25:49 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:49 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b.9f4840d1-abb5-4935-baeb-a97aa3c49eb4" returned: 0 in 0.280s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-9f4840d1-abb5-4935-baeb-a97aa3c49eb4" released by "_delete_snapshot" :: held 2.079s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" released by "delete_snapshot" :: held 2.112s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:49 devstack cinder-volume[87051]: WARNING cinder.quota [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-931633886 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-931633886, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:25:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['5ab26b29-824d-4919-9ff2-59783bd7f917', '6586a4fb-6069-43af-9252-c51ac703fbc3', 'de79d73f-20f5-4bd4-bdeb-a63967773970', '14d05205-8366-49a9-804a-6a24b29e6b4a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1855c083-d96b-4ad3-baf6-510c52dc7e0c tempest-GroupSnapshotsTest-1835411034 None] group_snapshot b5c7d2c3-b1d1-45ed-83f2-7baeea079aed: deleted successfully Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f637a-71bc-4001-84a3-3c78dfd27623]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:50 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:50 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:50 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:50 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b Sep 02 16:25:50 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:51 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-342ad230-fbff-4915-bc84-d061ea809c0b" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-342ad230-fbff-4915-bc84-d061ea809c0b" released by "delete_volume" :: held 0.825s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['4705a9fa-d0f8-4e67-bb5e-c2a1b9fca9c5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:51 devstack cinder-volume[87051]: WARNING cinder.db.api [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-931633886'] Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['2043f91d-f2b4-4617-81d7-402f30e6adac', 'cbf0a19e-9c09-48e6-8b4c-61903f361eb7', '562d79c7-1e84-4503-89ea-92e585678b59', '7915160d-7e33-4fb3-a108-a048c8626909'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:51 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:51 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:51 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.275s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:51 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:25:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-114a9f74-1199-4ebe-9276-a7926029b19e tempest-GroupSnapshotsTest-1835411034 None] Delete group completed successfully. Sep 02 16:25:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-74aa6b58-9f2e-496b-9137-90108ca17def tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1135748471: creating Sep 02 16:25:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-74aa6b58-9f2e-496b-9137-90108ca17def tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1135748471: created successfully Sep 02 16:25:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-74aa6b58-9f2e-496b-9137-90108ca17def tempest-GroupSnapshotsTest-1835411034 None] Create group completed successfully. Sep 02 16:25:54 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (aa0f438f-33fc-4cf1-8a38-a7c862417194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2026aff7-38bd-4bd8-b5f2-e7f3391c4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2026aff7-38bd-4bd8-b5f2-e7f3391c4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631132534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91f41d47-472f-423a-807c-686df07ec28b,host='devstack@QuobyteHD#QuobyteHD',id=cbd5cb59-c3bb-472a-93b8-21c69d5e1407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:55Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21033887-86b5-4d60-a635-f9ad6411ecfc),volume_type_id=21033887-86b5-4d60-a635-f9ad6411ecfc)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e058e53-0896-47ea-b416-fc67759c9f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e058e53-0896-47ea-b416-fc67759c9f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f42825-f334-4cef-a241-e92a98b6c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f42825-f334-4cef-a241-e92a98b6c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd5cb59-c3bb-472a-93b8-21c69d5e1407', 'volume_name': 'volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86fb0ad-5aeb-4b9b-9842-6a66a1dd0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86fb0ad-5aeb-4b9b-9842-6a66a1dd0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cca8a7b-b3b2-4de9-b1fc-314dcdb04b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Volume cbd5cb59-c3bb-472a-93b8-21c69d5e1407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407', 'volume_size': 1} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91f41d47-472f-423a-807c-686df07ec28b,created_at=2026-09-02T14:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631132534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91f41d47-472f-423a-807c-686df07ec28b,host='devstack@QuobyteHD#QuobyteHD',id=cbd5cb59-c3bb-472a-93b8-21c69d5e1407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:55Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21033887-86b5-4d60-a635-f9ad6411ecfc),volume_type_id=21033887-86b5-4d60-a635-f9ad6411ecfc)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Creating volume cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:55 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:55 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 1073741824 Sep 02 16:25:55 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:55 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 1073741824" returned: 0 in 0.603s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:55 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 Sep 02 16:25:55 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:56 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" returned: 0 in 0.337s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cca8a7b-b3b2-4de9-b1fc-314dcdb04b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae64256e-2c43-4530-b9ea-6764c9f75a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Volume volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 (cbd5cb59-c3bb-472a-93b8-21c69d5e1407): created successfully Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae64256e-2c43-4530-b9ea-6764c9f75a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (aa0f438f-33fc-4cf1-8a38-a7c862417194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0b213156-c416-4899-aa5a-3b5f37e6a51d tempest-GroupSnapshotsTest-1835411034 None] Created volume successfully. Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Flow 'volume_create_manager' (3496a347-2263-4cf0-9d4a-8a86ada66487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7fab61-9bd9-4ae3-8c9b-f326ce5be4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7fab61-9bd9-4ae3-8c9b-f326ce5be4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-67954949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be7acf60e341d2b96170da3f26eb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:56Z,use_quota=True,user_id='147ae3defd134915b44bf224b4743ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8796abd-99c2-4611-aa53-00aa483c41e2),volume_type_id=f8796abd-99c2-4611-aa53-00aa483c41e2)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0c2562-32be-40f4-b76d-91eda21c377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0c2562-32be-40f4-b76d-91eda21c377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3883526f-fc6a-4498-8c82-326741b99964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3883526f-fc6a-4498-8c82-326741b99964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe', 'volume_name': 'volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9505d7-b336-4521-bb1d-b6fdbbee363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9505d7-b336-4521-bb1d-b6fdbbee363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f2e2ec-f41b-452e-9ebc-4a2826d03e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Volume 44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe', 'volume_size': 1} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-67954949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be7acf60e341d2b96170da3f26eb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:56Z,use_quota=True,user_id='147ae3defd134915b44bf224b4743ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8796abd-99c2-4611-aa53-00aa483c41e2),volume_type_id=f8796abd-99c2-4611-aa53-00aa483c41e2)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Creating volume 44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:56 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:56 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe 1073741824 Sep 02 16:25:56 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:57 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe 1073741824" returned: 0 in 0.671s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:57 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe Sep 02 16:25:57 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Flow 'volume_create_manager' (a6acd9ab-e0b0-456a-94a5-24b9db928ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e824ceb-d7e5-412e-a4c4-f9b47be65991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e824ceb-d7e5-412e-a4c4-f9b47be65991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1257076064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caed6f46d96c44a8ae3649376bfd899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:57Z,use_quota=True,user_id='25fbac7e06f34236a6f0eb71dd723a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3af9de-9069-4f70-bb62-b385de90b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3af9de-9069-4f70-bb62-b385de90b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca9eecf-18be-41ac-b883-ee8a68028f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca9eecf-18be-41ac-b883-ee8a68028f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce', 'volume_name': 'volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc113c1-4b0f-41d4-9276-3ee4128a69ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc113c1-4b0f-41d4-9276-3ee4128a69ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae15ad97-cc47-48cf-a7bb-c1fb0a1884a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Volume 9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce', 'volume_size': 1} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (40b56d31-5eae-4778-ae49-67baef6b5498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404d2bed-862e-4ddc-a2bf-fb14fc7fe6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404d2bed-862e-4ddc-a2bf-fb14fc7fe6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126058901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91f41d47-472f-423a-807c-686df07ec28b,host='devstack@QuobyteHD#QuobyteHD',id=144004a3-e4fb-4d14-85bb-242a8d8f6198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:57Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21033887-86b5-4d60-a635-f9ad6411ecfc),volume_type_id=21033887-86b5-4d60-a635-f9ad6411ecfc)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a934ead-2bc3-43ff-bc97-861330225b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a934ead-2bc3-43ff-bc97-861330225b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f490e-90d8-48a1-8ec4-c0d1e0e4bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f490e-90d8-48a1-8ec4-c0d1e0e4bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144004a3-e4fb-4d14-85bb-242a8d8f6198', 'volume_name': 'volume-144004a3-e4fb-4d14-85bb-242a8d8f6198', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e51dd14-b608-469b-8e09-a771e3e5a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e51dd14-b608-469b-8e09-a771e3e5a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f78ab-6c98-4a3f-954a-0cd7fa97170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Volume 144004a3-e4fb-4d14-85bb-242a8d8f6198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144004a3-e4fb-4d14-85bb-242a8d8f6198', 'volume_size': 1} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" returned: 0 in 0.327s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1257076064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caed6f46d96c44a8ae3649376bfd899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:57Z,use_quota=True,user_id='25fbac7e06f34236a6f0eb71dd723a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Creating volume 9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:57 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:57 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce 1073741824 Sep 02 16:25:57 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f2e2ec-f41b-452e-9ebc-4a2826d03e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e26187-96cd-45be-8856-516f9cfffd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Volume volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe (44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe): created successfully Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e26187-96cd-45be-8856-516f9cfffd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Flow 'volume_create_manager' (3496a347-2263-4cf0-9d4a-8a86ada66487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-79bfa6db-5a4b-4acc-b020-c20790437a37 tempest-VolumeTypesAccessTest-848873794 None] Created volume successfully. Sep 02 16:25:58 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce 1073741824" returned: 0 in 0.467s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:58 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce Sep 02 16:25:58 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:58 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91f41d47-472f-423a-807c-686df07ec28b,created_at=2026-09-02T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126058901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91f41d47-472f-423a-807c-686df07ec28b,host='devstack@QuobyteHD#QuobyteHD',id=144004a3-e4fb-4d14-85bb-242a8d8f6198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:25:57Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21033887-86b5-4d60-a635-f9ad6411ecfc),volume_type_id=21033887-86b5-4d60-a635-f9ad6411ecfc)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Creating volume 144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:25:58 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:58 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 1073741824 Sep 02 16:25:58 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae15ad97-cc47-48cf-a7bb-c1fb0a1884a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735ce8a-5695-499b-9c56-1fcf24a1aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Acquiring lock "cinder-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:58 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Volume volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce (9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce): created successfully Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735ce8a-5695-499b-9c56-1fcf24a1aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Flow 'volume_create_manager' (a6acd9ab-e0b0-456a-94a5-24b9db928ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "cinder-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-1a3d6431-686d-487b-b152-300ec93d60ef req-9311cf8e-5103-415f-b921-22f9008ffe80 tempest-VolumesGetTestJSON-1573989820 None] Created volume successfully. Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Acquiring lock "cinder-quobyte-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "cinder-quobyte-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b69f11-bfeb-44e8-a1a9-dd33f84ac524]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:58 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe Sep 02 16:25:58 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:58 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 1073741824" returned: 0 in 0.506s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:58 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 Sep 02 16:25:58 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:59 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:59 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe Sep 02 16:25:59 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:59 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f78ab-6c98-4a3f-954a-0cd7fa97170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144004a3-e4fb-4d14-85bb-242a8d8f6198', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dfa629-77de-440b-89b6-ba990a30c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:25:59 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Volume volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 (144004a3-e4fb-4d14-85bb-242a8d8f6198): created successfully Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dfa629-77de-440b-89b6-ba990a30c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (40b56d31-5eae-4778-ae49-67baef6b5498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:25:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2901be3f-0b84-4153-a1fc-498a5b6261ea tempest-GroupSnapshotsTest-1835411034 None] Created volume successfully. Sep 02 16:25:59 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" returned: 0 in 0.323s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "cinder-quobyte-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe" released by "delete_volume" :: held 0.810s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:25:59 devstack cinder-volume[87051]: WARNING cinder.quota [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1813450463 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1813450463, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:25:59 devstack cinder-volume[87051]: WARNING cinder.quota [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1813450463 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1813450463, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Created reservations ['0d106b13-fd06-4ef0-b4fe-0499400614e3', 'a3692393-a9a0-477f-81f5-eebd83746399', '55338b44-aae7-41be-859a-3848b9a18fac', 'b86578ad-fb25-46d1-b2d2-79d51436c344'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Acquiring lock "cinder-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "cinder-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:59 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:25:59 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Acquiring lock "cinder-quobyte-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "cinder-quobyte-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[815c02a4-1f40-43ae-a2b6-cf03b64959cc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:25:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:25:59 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce Sep 02 16:26:00 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:00 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.411s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Deleted volume successfully. Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1785a864-7e93-4521-93b0-9cff914adc16 tempest-VolumeTypesAccessTest-848873794 None] Lock "cinder-44d98a8d-afbb-43c2-b2e9-f1fcb9b99dfe-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-90fb9f3c-0eea-49d4-bdeb-356e97793c5a tempest-GroupSnapshotsTest-1835411034 None] Update group completed successfully. Sep 02 16:26:00 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" returned: 0 in 0.626s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:00 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce Sep 02 16:26:00 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:00 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "cinder-quobyte-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce" released by "delete_volume" :: held 1.028s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.quota [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Created reservations ['032133b6-e58a-47ca-9a2d-9755c6b418df', 'e6f7a3d8-25cc-43b4-8d7a-74af14ab4150', 'a3570068-1109-4bf1-b967-4bda7d184e8c', 'b487e585-2eaf-4f7c-81f5-caf3bd3b968f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:00 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:00 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:01 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:01 devstack cinder-volume[87051]: DEBUG cinder.manager [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Deleted volume successfully. Sep 02 16:26:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-80a17a40-1dd2-4aff-b6ed-f94cd9ded3d6 req-556dcd78-afda-45ea-a88b-a2352254414c tempest-VolumesGetTestJSON-1573989820 None] Lock "cinder-9b0fc98a-2c0d-4c78-bf61-4a3af3e4ebce-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a70745ea-9568-4bd2-a244-d216dfa3e65e tempest-GroupSnapshotsTest-1835411034 None] Update group completed successfully. Sep 02 16:26:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5c2476fe-350f-4ad1-8462-1ff4c2458bf3 tempest-GroupSnapshotsTest-1835411034 None] Update group completed successfully. Sep 02 16:26:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4607562b-8585-4931-9301-36b58fec18ff tempest-GroupSnapshotsTest-1835411034 None] Update group completed successfully. Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (0760b1ea-84e0-4cd5-8b29-49ae6e3848da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2ca2a5-192a-41c7-af01-90970755c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2ca2a5-192a-41c7-af01-90970755c520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1763306177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c68d126-e7eb-49b0-b5e7-9925d4ea7c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:05Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a65f819d-b6c8-4396-8edf-187623c4e1f9),volume_type_id=a65f819d-b6c8-4396-8edf-187623c4e1f9)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7300b27-8035-44d5-90b9-bd52cc8c16c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7300b27-8035-44d5-90b9-bd52cc8c16c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abc4607-cb71-4d6a-8fde-1eb1cb532d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abc4607-cb71-4d6a-8fde-1eb1cb532d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c68d126-e7eb-49b0-b5e7-9925d4ea7c59', 'volume_name': 'volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32313d00-faa6-4b1b-bbf9-e6919399f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32313d00-faa6-4b1b-bbf9-e6919399f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f318dd9-d9b3-491e-a87f-34c84ba1936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume 7c68d126-e7eb-49b0-b5e7-9925d4ea7c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59', 'volume_size': 1} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1763306177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c68d126-e7eb-49b0-b5e7-9925d4ea7c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:05Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a65f819d-b6c8-4396-8edf-187623c4e1f9),volume_type_id=a65f819d-b6c8-4396-8edf-187623c4e1f9)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Creating volume 7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:05 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 1073741824 Sep 02 16:26:05 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] GroupSnapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: creating. Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Group snapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: creating. {{(pid=87051) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 16:26:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (6006a94a-f41e-4f8e-8b66-c6e7d3477985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc62d9-cf3c-439e-9838-78dae5c976b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc62d9-cf3c-439e-9838-78dae5c976b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-26407662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1308725-1703-4a12-921f-c4948f80d700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:06Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f99200d1-80d4-4c70-8db0-569a177f0e80),volume_type_id=f99200d1-80d4-4c70-8db0-569a177f0e80)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9be85c-03b5-4c78-981b-bf13e0f4b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9be85c-03b5-4c78-981b-bf13e0f4b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfebba98-4572-4620-bd1f-1a49237d15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfebba98-4572-4620-bd1f-1a49237d15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1308725-1703-4a12-921f-c4948f80d700', 'volume_name': 'volume-e1308725-1703-4a12-921f-c4948f80d700', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7682158-c62d-4fc4-b83e-443a555a67d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7682158-c62d-4fc4-b83e-443a555a67d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190053b-a932-46f8-862c-19d235f0cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume e1308725-1703-4a12-921f-c4948f80d700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1308725-1703-4a12-921f-c4948f80d700', 'volume_size': 1} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:06 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 1073741824" returned: 0 in 0.651s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:06 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 Sep 02 16:26:06 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:06 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" returned: 0 in 0.342s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.724s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f318dd9-d9b3-491e-a87f-34c84ba1936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecf4878-14f1-48ad-ac35-71663138577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Creating offline snapshot 5e23059b-15af-466d-869f-05819d7b3aa7 of volume 144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:26:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 (7c68d126-e7eb-49b0-b5e7-9925d4ea7c59): created successfully Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecf4878-14f1-48ad-ac35-71663138577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (0760b1ea-84e0-4cd5-8b29-49ae6e3848da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5859aa18-da3d-406b-bf00-073517d35449]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fd4b57c3-caf7-4cdf-8482-d99f34b89ea6 tempest-TestInstancesWithCinderVolumes-1916189969 None] Created volume successfully. Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (7b4c8440-f1b9-4926-8dc3-5ee3ac298b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150d5576-52d9-4ec5-8054-05c84bcb76c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 Sep 02 16:26:06 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150d5576-52d9-4ec5-8054-05c84bcb76c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-927753338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607c253c-266e-43f8-8923-23957fb7a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:07Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e28989e8-e19b-4df6-8add-d670af4228f0),volume_type_id=e28989e8-e19b-4df6-8add-d670af4228f0)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e54493-3457-4ad9-90ca-70cd51c9813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e54493-3457-4ad9-90ca-70cd51c9813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e87698-909f-4ac7-81a5-73e462d338e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:06 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (ffee001c-3722-4073-94ae-cc8c5cec5278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ecdd07-e69c-4e47-a328-3f1de223eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198" returned: 0 in 0.555s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ecdd07-e69c-4e47-a328-3f1de223eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-248094022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1c23b0-8230-4213-ba9c-c66df39ca098,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:07Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ef6bef-1d4e-4da9-8387-9686777a7e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ef6bef-1d4e-4da9-8387-9686777a7e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 1G Sep 02 16:26:07 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c76315b-b087-4a53-b368-33b6021d5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c76315b-b087-4a53-b368-33b6021d5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1c23b0-8230-4213-ba9c-c66df39ca098', 'volume_name': 'volume-7d1c23b0-8230-4213-ba9c-c66df39ca098', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee1eb04-c719-482c-a069-f74ae85174c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee1eb04-c719-482c-a069-f74ae85174c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6f24e8-24e9-4aae-8677-27664631be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Volume 7d1c23b0-8230-4213-ba9c-c66df39ca098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1c23b0-8230-4213-ba9c-c66df39ca098', 'volume_size': 1} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e87698-909f-4ac7-81a5-73e462d338e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '607c253c-266e-43f8-8923-23957fb7a324', 'volume_name': 'volume-607c253c-266e-43f8-8923-23957fb7a324', 'volume_size': 1, 'image_id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165925511', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2b5bb29a92843179a4ec5bb48b2b8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'created_at': datetime.datetime(2026, 9, 2, 14, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e472f111-64d4-45b8-b505-cfafd3b77442/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a07310-b5c9-4577-a2ca-d4b646472feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a07310-b5c9-4577-a2ca-d4b646472feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d58b699-e1c9-4b83-b64a-344fbee25dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume 607c253c-266e-43f8-8923-23957fb7a324: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-607c253c-266e-43f8-8923-23957fb7a324', 'volume_size': 1, 'image_id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165925511', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2b5bb29a92843179a4ec5bb48b2b8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'created_at': datetime.datetime(2026, 9, 2, 14, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e472f111-64d4-45b8-b505-cfafd3b77442/file', 'properties': {}}, 'image_service': } Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Trying to clone 607c253c-266e-43f8-8923-23957fb7a324 from image e472f111-64d4-45b8-b505-cfafd3b77442 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:26:07 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 1G" returned: 0 in 0.489s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:07 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 Sep 02 16:26:07 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:08 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:08 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:08 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 Sep 02 16:26:08 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:08 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:08 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info Sep 02 16:26:08 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:08 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:08 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:08 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info Sep 02 16:26:08 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:08 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.info" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Creating offline snapshot bcdca36e-e776-478f-bc4f-a156905b46fa of volume cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c0ebe-37ed-47b8-b925-8833536eb79d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:09 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 Sep 02 16:26:09 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:09 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" returned: 0 in 0.409s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:09 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa 1G Sep 02 16:26:09 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:09 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa 1G" returned: 0 in 0.471s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:09 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa Sep 02 16:26:09 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:10 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa" returned: 0 in 0.402s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:10 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:10 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa Sep 02 16:26:10 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:10 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa" returned: 0 in 0.265s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:10 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info Sep 02 16:26:10 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:10 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:10 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:10 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info Sep 02 16:26:10 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:11 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.info" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.834s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-248094022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1c23b0-8230-4213-ba9c-c66df39ca098,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:07Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Creating volume 7d1c23b0-8230-4213-ba9c-c66df39ca098 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:11 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:11 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 1073741824 Sep 02 16:26:11 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-606656f6-775f-4f12-9431-bf6747f6480d tempest-GroupSnapshotsTest-1835411034 None] group_snapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: created successfully Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD, size 20.69 MB, duration 3.98 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:26:11 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Image download 20.69 MB at 5.20 MB/s Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c3fde-17b9-4663-8932-ef4e9fce8b5e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:11 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD Sep 02 16:26:11 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:11 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 1073741824" returned: 0 in 0.537s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:11 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 Sep 02 16:26:11 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:11 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Temporary image e472f111-64d4-45b8-b505-cfafd3b77442 is fetched for user f3d4f3c08bcd4368b666c5a1fd923f90. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[581b61d5-a576-41bc-a5b5-ad1e76b540eb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:11 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098" returned: 0 in 0.271s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.859s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-26407662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1308725-1703-4a12-921f-c4948f80d700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:06Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f99200d1-80d4-4c70-8db0-569a177f0e80),volume_type_id=f99200d1-80d4-4c70-8db0-569a177f0e80)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Creating volume e1308725-1703-4a12-921f-c4948f80d700 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:12 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:12 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6f24e8-24e9-4aae-8677-27664631be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1c23b0-8230-4213-ba9c-c66df39ca098', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:12 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab588b-acec-4316-a741-1543c8052aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:12 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 1073741824 Sep 02 16:26:12 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Volume volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 (7d1c23b0-8230-4213-ba9c-c66df39ca098): created successfully Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab588b-acec-4316-a741-1543c8052aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (ffee001c-3722-4073-94ae-cc8c5cec5278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3c57cd95-1bf3-4c4f-8959-2bb1233eb532 tempest-VolumesTestJSON-502605218 None] Created volume successfully. Sep 02 16:26:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] group_snapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: deleting Sep 02 16:26:12 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] group_snapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: deleting {{(pid=87051) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-5e23059b-15af-466d-869f-05819d7b3aa7" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-5e23059b-15af-466d-869f-05819d7b3aa7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Deleting offline snapshot 5e23059b-15af-466d-869f-05819d7b3aa7 of volume 144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] snapshot_file for this snap is: volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae43d941-fcc6-4bb1-baa4-a14eb1da6324]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:12 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 Sep 02 16:26:12 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:12 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 1073741824" returned: 0 in 0.702s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:12 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 Sep 02 16:26:12 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:13 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7" returned: 0 in 0.545s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-144004a3-e4fb-4d14-85bb-242a8d8f6198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55dc929-6c80-414d-a710-3f7ccd73917b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:13 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700" returned: 0 in 0.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-927753338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607c253c-266e-43f8-8923-23957fb7a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5bb29a92843179a4ec5bb48b2b8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:07Z,use_quota=True,user_id='f3d4f3c08bcd4368b666c5a1fd923f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e28989e8-e19b-4df6-8add-d670af4228f0),volume_type_id=e28989e8-e19b-4df6-8add-d670af4228f0)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Creating volume 607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:13 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=187,cinder:INSERT=46,cinder:UPDATE=181,cinder:DELETE=11 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190053b-a932-46f8-862c-19d235f0cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1308725-1703-4a12-921f-c4948f80d700', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1073741824 Sep 02 16:26:13 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a982a-850d-4c41-9637-47c7947ed264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:INSERT=44,cinder:UPDATE=178,cinder:SELECT=160,cinder:DELETE=9 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:26:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume volume-e1308725-1703-4a12-921f-c4948f80d700 (e1308725-1703-4a12-921f-c4948f80d700): created successfully Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a982a-850d-4c41-9637-47c7947ed264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (6006a94a-f41e-4f8e-8b66-c6e7d3477985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:13 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 Sep 02 16:26:13 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (def1717e-c07c-4112-a68b-195632c220c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467321b-3043-4b68-a2e6-e6dcd1b07352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e12bdd13-1c86-440f-a4a5-307a55591634 tempest-TestInstancesWithCinderVolumes-1916189969 None] Created volume successfully. Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467321b-3043-4b68-a2e6-e6dcd1b07352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1556139242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7ba95-e210-43c9-b7bc-f54febbb5bc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:13Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee1115-d26e-4569-80dc-83b94089a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee1115-d26e-4569-80dc-83b94089a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bf6c25-be97-416d-98f4-2382c8060b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bf6c25-be97-416d-98f4-2382c8060b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a7ba95-e210-43c9-b7bc-f54febbb5bc5', 'volume_name': 'volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608624df-ba24-4b82-a899-2fc1ed13b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608624df-ba24-4b82-a899-2fc1ed13b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529a728-fdd8-45ec-a778-97ae58fe95a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Volume 92a7ba95-e210-43c9-b7bc-f54febbb5bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5', 'volume_size': 1} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:13 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:13 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198" returned: 0 in 0.563s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1073741824" returned: 0 in 0.512s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:13 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 Sep 02 16:26:13 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:13 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 Sep 02 16:26:13 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:13 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1556139242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7ba95-e210-43c9-b7bc-f54febbb5bc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:13Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Creating volume 92a7ba95-e210-43c9-b7bc-f54febbb5bc5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:14 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 1073741824 Sep 02 16:26:14 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Attempting download of e472f111-64d4-45b8-b505-cfafd3b77442 ((None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}])) to volume 607c253c-266e-43f8-8923-23957fb7a324. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:26:14 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f3c73d-16f3-479b-b87a-247cbe912bdd]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7 Sep 02 16:26:14 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj Sep 02 16:26:14 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198.5e23059b-15af-466d-869f-05819d7b3aa7" returned: 0 in 0.346s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-5e23059b-15af-466d-869f-05819d7b3aa7" released by "_delete_snapshot" :: held 2.042s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" released by "delete_snapshot" :: held 2.086s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-bcdca36e-e776-478f-bc4f-a156905b46fa" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-bcdca36e-e776-478f-bc4f-a156905b46fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:14 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Deleting offline snapshot bcdca36e-e776-478f-bc4f-a156905b46fa of volume cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:26:14 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] snapshot_file for this snap is: volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj" returned: 0 in 0.496s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 1073741824" returned: 0 in 0.611s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c879ad9-efb7-4212-b267-ab70c31a86a7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (31ea4863-10e2-4a6e-be3c-936d0f11d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23efa9d1-fa81-4d82-97dd-d12bbac6236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23efa9d1-fa81-4d82-97dd-d12bbac6236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1706687787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15149fe0-10ff-48a6-abfd-23a7cf541746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:15Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc68c53-2417-4437-acdd-9bebb7cc4e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:14 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj Sep 02 16:26:14 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc68c53-2417-4437-acdd-9bebb7cc4e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9711bc2-639e-4ae0-9e87-ffe8e9bd1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9711bc2-639e-4ae0-9e87-ffe8e9bd1182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15149fe0-10ff-48a6-abfd-23a7cf541746', 'volume_name': 'volume-15149fe0-10ff-48a6-abfd-23a7cf541746', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4353544f-f9c1-48e9-a23e-1b887eb82b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4353544f-f9c1-48e9-a23e-1b887eb82b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d6928-312c-4be9-b805-590e5bd2abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Volume 15149fe0-10ff-48a6-abfd-23a7cf541746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15149fe0-10ff-48a6-abfd-23a7cf541746', 'volume_size': 1} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:14 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:14 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 Sep 02 16:26:14 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:14 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj" returned: 1 in 0.355s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e472f111-64d4-45b8-b505-cfafd3b77442_9527qysj' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87bb1c-bb96-4b94-8976-073d0a5911c4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:15 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1706687787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15149fe0-10ff-48a6-abfd-23a7cf541746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:15Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Creating volume 15149fe0-10ff-48a6-abfd-23a7cf541746 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:15 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa" returned: 0 in 0.420s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:26:15 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 1073741824 Sep 02 16:26:15 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529a728-fdd8-45ec-a778-97ae58fe95a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48190ee2-e1fc-489a-975a-31597c9c5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc6d17-6b5e-4080-b929-11158632320a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD Sep 02 16:26:15 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Volume volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 (92a7ba95-e210-43c9-b7bc-f54febbb5bc5): created successfully Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48190ee2-e1fc-489a-975a-31597c9c5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (def1717e-c07c-4112-a68b-195632c220c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e705b4a2-1845-40af-9cfd-202f6ba920c1 tempest-VolumesTestJSON-502605218 None] Created volume successfully. Sep 02 16:26:15 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 Sep 02 16:26:15 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] e472f111-64d4-45b8-b505-cfafd3b77442 was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 Sep 02 16:26:15 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" returned: 0 in 0.454s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 1073741824" returned: 0 in 0.537s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:15 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa Sep 02 16:26:15 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:15 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 Sep 02 16:26:15 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:15 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (17aefb99-db84-4af3-97e8-19b05278df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4766b2-2eee-4360-a3c7-665170c1b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa" returned: 0 in 0.460s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4766b2-2eee-4360-a3c7-665170c1b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1013398826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627f75a-bdd9-40ce-b50c-72ba0845db08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:16Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa Sep 02 16:26:16 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc0dac8-dbc8-494e-af0d-0dfe95821a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc0dac8-dbc8-494e-af0d-0dfe95821a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0527c901-9af4-4cd5-88a2-702f1dc1fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0527c901-9af4-4cd5-88a2-702f1dc1fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6627f75a-bdd9-40ce-b50c-72ba0845db08', 'volume_name': 'volume-6627f75a-bdd9-40ce-b50c-72ba0845db08', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e7f935-d7a1-4b22-99cf-5443cea20dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e7f935-d7a1-4b22-99cf-5443cea20dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037cedb8-226d-4fa9-a12b-707c7ab831b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Volume 6627f75a-bdd9-40ce-b50c-72ba0845db08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6627f75a-bdd9-40ce-b50c-72ba0845db08', 'volume_size': 1} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1013398826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627f75a-bdd9-40ce-b50c-72ba0845db08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a62e3ebd72948589f8b7c5a5ceb6ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:16Z,use_quota=True,user_id='31923f2b716a4ae09e089f3b3a77ed34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Creating volume 6627f75a-bdd9-40ce-b50c-72ba0845db08 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d6928-312c-4be9-b805-590e5bd2abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15149fe0-10ff-48a6-abfd-23a7cf541746', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f3726-f8f1-4037-a32f-6b9fa55372de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:16 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 1073741824 Sep 02 16:26:16 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Volume volume-15149fe0-10ff-48a6-abfd-23a7cf541746 (15149fe0-10ff-48a6-abfd-23a7cf541746): created successfully Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f3726-f8f1-4037-a32f-6b9fa55372de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (31ea4863-10e2-4a6e-be3c-936d0f11d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d4a1fe53-f71b-4d15-b8b6-7f1a3ab24c53 tempest-VolumesListAdminTestJSON-35826402 None] Created volume successfully. Sep 02 16:26:16 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407.bcdca36e-e776-478f-bc4f-a156905b46fa" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-bcdca36e-e776-478f-bc4f-a156905b46fa" released by "_delete_snapshot" :: held 1.760s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" released by "delete_snapshot" :: held 1.786s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:16 devstack cinder-volume[87051]: WARNING cinder.quota [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-281410695 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-281410695, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:16 devstack cinder-volume[87051]: WARNING cinder.quota [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-281410695 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-281410695, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['92040bde-c3e5-460a-b2e7-1c71499a9bb7', '8637656e-1149-4d4f-9142-366a490bf244', 'fa1f80e6-be3e-4fbb-a319-6c2189b96c9d', 'e302b01f-9ab7-46ee-9d46-142f2dc0ce81'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['cc56eead-c352-4cbd-90e7-57c3cff6f015', '022a4e2a-8634-498e-aef4-d1f0a3b97287', '3dfd410f-7d36-434f-a054-1da2a9485afb', '57c06ba4-1055-459b-b5cb-a66f97337e65'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:16 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 1073741824" returned: 0 in 0.578s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9f81b3da-f2bc-42de-9ca7-1d61a7ea1c8f tempest-GroupSnapshotsTest-1835411034 None] group_snapshot c5598c4d-1d89-416c-b6e6-1f69927184fa: deleted successfully Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:16 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 Sep 02 16:26:16 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:16 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08" returned: 0 in 0.270s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037cedb8-226d-4fa9-a12b-707c7ab831b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6627f75a-bdd9-40ce-b50c-72ba0845db08', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e792b165-fdb3-4f82-9b95-be8894e9c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Volume volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 (6627f75a-bdd9-40ce-b50c-72ba0845db08): created successfully Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e792b165-fdb3-4f82-9b95-be8894e9c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Flow 'volume_create_manager' (17aefb99-db84-4af3-97e8-19b05278df92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-977cb125-25d3-4228-aa73-318dbc8996a5 tempest-VolumesTestJSON-502605218 None] Created volume successfully. Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:17 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324" returned: 0 in 2.083s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e472f111-64d4-45b8-b505-cfafd3b77442_bsy09c5jdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Converted 112.00 MB image at 53.75 MB/s Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[825573c3-f8b5-4df9-8825-5b55728d3d5b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:17 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1G Sep 02 16:26:17 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (47d25e3e-9e41-41f9-830b-b71a0f763ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a364a6-0d2b-469d-b93c-d88b329e418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a364a6-0d2b-469d-b93c-d88b329e418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722079811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:17Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0142460e-8867-486f-9e21-d810cf19b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0142460e-8867-486f-9e21-d810cf19b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 Sep 02 16:26:17 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3511b2-c69f-4422-a82c-5a2397c2c5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3511b2-c69f-4422-a82c-5a2397c2c5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1', 'volume_name': 'volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980d53bd-beff-4bea-bc5a-2d652d84f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980d53bd-beff-4bea-bc5a-2d652d84f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ef8992-00c5-4074-88da-cc3deb7c42d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Volume b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1', 'volume_size': 1} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722079811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:17Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Creating volume b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:17 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 1073741824 Sep 02 16:26:17 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:17 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 1G" returned: 0 in 0.346s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Downloaded image e472f111-64d4-45b8-b505-cfafd3b77442 ((None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}])) to volume 607c253c-266e-43f8-8923-23957fb7a324 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Temporary image e472f111-64d4-45b8-b505-cfafd3b77442 for user f3d4f3c08bcd4368b666c5a1fd923f90 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Marking volume 607c253c-266e-43f8-8923-23957fb7a324 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Copying metadata from image e472f111-64d4-45b8-b505-cfafd3b77442 to 607c253c-266e-43f8-8923-23957fb7a324. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Creating volume glance metadata for volume 607c253c-266e-43f8-8923-23957fb7a324 backed by image e472f111-64d4-45b8-b505-cfafd3b77442 with: {'image_id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'image_name': 'tempest-scenario-img--165925511', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:26:17 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d58b699-e1c9-4b83-b64a-344fbee25dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607c253c-266e-43f8-8923-23957fb7a324', 'volume_size': 1, 'image_id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e472f111-64d4-45b8-b505-cfafd3b77442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165925511', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2b5bb29a92843179a4ec5bb48b2b8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e472f111-64d4-45b8-b505-cfafd3b77442', 'created_at': datetime.datetime(2026, 9, 2, 14, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e472f111-64d4-45b8-b505-cfafd3b77442/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb4a357-5b40-4836-a96d-8ff802a20a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198" returned: 0 in 0.448s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Volume volume-607c253c-266e-43f8-8923-23957fb7a324 (607c253c-266e-43f8-8923-23957fb7a324): created successfully Sep 02 16:26:17 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198 Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb4a357-5b40-4836-a96d-8ff802a20a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:17 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Flow 'volume_create_manager' (7b4c8440-f1b9-4926-8dc3-5ee3ac298b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-595a0507-e9c1-45c7-be26-87c4c462ae1b tempest-TestInstancesWithCinderVolumes-1916189969 None] Created volume successfully. Sep 02 16:26:18 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 1073741824" returned: 0 in 0.493s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:18 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 Sep 02 16:26:18 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:18 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-144004a3-e4fb-4d14-85bb-242a8d8f6198" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-144004a3-e4fb-4d14-85bb-242a8d8f6198" released by "delete_volume" :: held 0.832s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e1ea7d-c1f4-40be-a365-0b15c3ca25b6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:18 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 Sep 02 16:26:18 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:18 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" returned: 0 in 0.284s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ef8992-00c5-4074-88da-cc3deb7c42d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbac345f-bff0-4c21-a174-fef2ece41229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Volume volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 (b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1): created successfully Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbac345f-bff0-4c21-a174-fef2ece41229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (47d25e3e-9e41-41f9-830b-b71a0f763ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ec3a9da6-c1b4-4ad9-bcef-cb2cda661f26 tempest-VolumesListAdminTestJSON-35826402 None] Created volume successfully. Sep 02 16:26:18 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:18 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407 Sep 02 16:26:18 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:19 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-cbd5cb59-c3bb-472a-93b8-21c69d5e1407" released by "delete_volume" :: held 0.806s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-6627f75a-bdd9-40ce-b50c-72ba0845db08-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "cinder-6627f75a-bdd9-40ce-b50c-72ba0845db08-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['1c8eb5e3-5e19-4e7d-8995-7cedb3cbe8bb'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-quobyte-6627f75a-bdd9-40ce-b50c-72ba0845db08" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-6627f75a-bdd9-40ce-b50c-72ba0845db08" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:19 devstack cinder-volume[87051]: WARNING cinder.quota [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-281410695 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-281410695, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb57b6a7-dc51-4438-84d9-5e6ff4449141]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['7ab7d1d1-4525-4679-896d-6ffde59fe8b6', '8542cd0b-17c2-4ce3-8d5c-ab691791cd32', '99eeb599-1e10-43b2-ab08-a6c908201b48', '7f907bd1-e6e8-4e04-bbe1-d09de904b3f6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:19 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 Sep 02 16:26:19 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['4940fb42-558c-454d-8b6c-9b3d7fbbe87d', '3b575070-9cf4-4532-8f11-01fcfcd04d96', '98f5d417-42d0-47be-9d18-e7259ad24dba', '9337ddf8-a2d5-4afa-8254-f59815f50095'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:19 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:19 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:19 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08" returned: 0 in 0.422s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:19 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08 Sep 02 16:26:19 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:19 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:19 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-89b1d33a-ccd6-468b-a313-ed69fe2feb1b tempest-GroupSnapshotsTest-1835411034 None] Delete group completed successfully. Sep 02 16:26:20 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6627f75a-bdd9-40ce-b50c-72ba0845db08" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-6627f75a-bdd9-40ce-b50c-72ba0845db08" released by "delete_volume" :: held 0.850s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Created reservations ['f2caa709-775f-4401-8735-53c7cfd4e27b', 'e8b88769-df9f-4dc4-b9dc-9c21eebbe9a7', '0cec6b2f-45be-46af-a67d-e61919249291', '08ffff9f-b81d-4266-a579-e2d6e5594ca1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:20 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:20 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (1ac0c2af-4979-48ee-a94d-413f6949e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed713515-1d46-4e4e-83f0-6463126c93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-92a7ba95-e210-43c9-b7bc-f54febbb5bc5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed713515-1d46-4e4e-83f0-6463126c93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607477105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6001c2c-b428-483b-8e9c-edec824fb43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:20Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de412c24-8d8c-4fab-8b46-3fc84bea57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de412c24-8d8c-4fab-8b46-3fc84bea57d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf53146-10b0-4436-971d-5748c1762b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf53146-10b0-4436-971d-5748c1762b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6001c2c-b428-483b-8e9c-edec824fb43f', 'volume_name': 'volume-b6001c2c-b428-483b-8e9c-edec824fb43f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9943b9a0-56e2-4565-b4d9-ca9f1cc52987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9943b9a0-56e2-4565-b4d9-ca9f1cc52987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3815f0f9-2480-47b3-abff-025f6324255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Volume b6001c2c-b428-483b-8e9c-edec824fb43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6001c2c-b428-483b-8e9c-edec824fb43f', 'volume_size': 1} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607477105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6001c2c-b428-483b-8e9c-edec824fb43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679a83a18684b2da46c522ed9447a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:20Z,use_quota=True,user_id='9fa06e385dc74eaaa1a90f09b5a89d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Creating volume b6001c2c-b428-483b-8e9c-edec824fb43f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:20 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f 1073741824 Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "cinder-92a7ba95-e210-43c9-b7bc-f54febbb5bc5-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:20 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b1bade9a-5d05-48d7-8000-dd58a2b6f2e5 tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1436742074: creating Sep 02 16:26:20 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.350s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-quobyte-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Deleted volume successfully. Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b1bade9a-5d05-48d7-8000-dd58a2b6f2e5 tempest-GroupSnapshotsTest-1835411034 None] Group tempest-GroupSnapshotsTest-Group-1436742074: created successfully Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d37850fd-9c18-402e-b144-fb95d76bc8b5 tempest-VolumesTestJSON-502605218 None] Lock "cinder-6627f75a-bdd9-40ce-b50c-72ba0845db08-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b1bade9a-5d05-48d7-8000-dd58a2b6f2e5 tempest-GroupSnapshotsTest-1835411034 None] Create group completed successfully. Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c73c4-1ab1-42f6-ade4-4416af06d0f4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:20 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 Sep 02 16:26:20 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:21 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f 1073741824" returned: 0 in 0.516s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:21 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f Sep 02 16:26:21 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:21 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:21 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5 Sep 02 16:26:21 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:21 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3815f0f9-2480-47b3-abff-025f6324255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6001c2c-b428-483b-8e9c-edec824fb43f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f14027c-ed1a-4d4c-a9a1-bc2f58bc095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:21 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" returned: 0 in 0.311s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:21 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Volume volume-b6001c2c-b428-483b-8e9c-edec824fb43f (b6001c2c-b428-483b-8e9c-edec824fb43f): created successfully Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f14027c-ed1a-4d4c-a9a1-bc2f58bc095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Flow 'volume_create_manager' (1ac0c2af-4979-48ee-a94d-413f6949e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-92a7ba95-e210-43c9-b7bc-f54febbb5bc5" released by "delete_volume" :: held 0.810s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c64e0991-234b-4245-9d8a-8ab6e5552288 tempest-VolumesListAdminTestJSON-35826402 None] Created volume successfully. Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Created reservations ['04918b8d-aa68-49e6-a815-3f99e80989bc', '3badb4a3-8c88-4bb9-8c23-c712c7e041e6', 'c6fe74cc-e125-4253-bad3-012270a0b4f2', 'abdfd191-e42f-420f-94a0-90950b5fba93'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:21 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:21 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-c5ad91c7-96ea-422c-90fb-694e08bf4c92 req-e37fff8f-5178-49fb-8f60-8d9a7f571b77 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-c5ad91c7-96ea-422c-90fb-694e08bf4c92 req-e37fff8f-5178-49fb-8f60-8d9a7f571b77 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-c5ad91c7-96ea-422c-90fb-694e08bf4c92 req-e37fff8f-5178-49fb-8f60-8d9a7f571b77 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:21 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-c5ad91c7-96ea-422c-90fb-694e08bf4c92 req-e37fff8f-5178-49fb-8f60-8d9a7f571b77 tempest-TestInstancesWithCinderVolumes-1916189969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-607c253c-266e-43f8-8923-23957fb7a324', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67875395-3da5-4982-b418-8e47410570df', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Deleted volume successfully. Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-17222737-9c2d-4a08-93c6-97097d9c153e tempest-VolumesTestJSON-502605218 None] Lock "cinder-92a7ba95-e210-43c9-b7bc-f54febbb5bc5-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-c5ad91c7-96ea-422c-90fb-694e08bf4c92 req-e37fff8f-5178-49fb-8f60-8d9a7f571b77 tempest-TestInstancesWithCinderVolumes-1916189969 None] attachment_update completed successfully. Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (74798150-3d8c-4f9a-b76d-60ad098838ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33f2f97-e9f0-48fc-b779-f52b91ebcb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33f2f97-e9f0-48fc-b779-f52b91ebcb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094068575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e8c41-dd23-4297-89e5-7cb9be3f5673,host='devstack@QuobyteHD#QuobyteHD',id=4f058776-99b7-488a-875d-3919185d680a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:22Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ea497aa-238d-4788-bc6f-339e11892bc2),volume_type_id=4ea497aa-238d-4788-bc6f-339e11892bc2)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9648e7-bd0d-4529-83a9-f7542b453b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9648e7-bd0d-4529-83a9-f7542b453b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b0c3cc-6e27-4aed-9ea4-1e65782ce92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b0c3cc-6e27-4aed-9ea4-1e65782ce92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f058776-99b7-488a-875d-3919185d680a', 'volume_name': 'volume-4f058776-99b7-488a-875d-3919185d680a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02432e-17a3-468f-982a-360f2f1207fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02432e-17a3-468f-982a-360f2f1207fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b4ff14-b8a7-4ab5-831a-4e84fd089ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:22 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Volume 4f058776-99b7-488a-875d-3919185d680a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f058776-99b7-488a-875d-3919185d680a', 'volume_size': 1} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b03e8c41-dd23-4297-89e5-7cb9be3f5673,created_at=2026-09-02T14:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094068575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e8c41-dd23-4297-89e5-7cb9be3f5673,host='devstack@QuobyteHD#QuobyteHD',id=4f058776-99b7-488a-875d-3919185d680a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c762480e6b9a48a0b33ae7d4397fed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:22Z,use_quota=True,user_id='7aa752e90aed452c870ceba128eabeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ea497aa-238d-4788-bc6f-339e11892bc2),volume_type_id=4ea497aa-238d-4788-bc6f-339e11892bc2)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Creating volume 4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:22 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a 1073741824 Sep 02 16:26:22 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-7d1c23b0-8230-4213-ba9c-c66df39ca098-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "cinder-7d1c23b0-8230-4213-ba9c-c66df39ca098-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Acquiring lock "cinder-quobyte-7d1c23b0-8230-4213-ba9c-c66df39ca098" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-7d1c23b0-8230-4213-ba9c-c66df39ca098" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a442a-41df-4ab6-9472-b30ef847bdfd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:23 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 Sep 02 16:26:23 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:23 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a 1073741824" returned: 0 in 0.622s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:23 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a Sep 02 16:26:23 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:23 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098" returned: 0 in 0.497s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:23 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098 Sep 02 16:26:23 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Flow 'volume_create_manager' (a9ea977e-19da-46a6-aa15-eba5474b1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cd9383-a418-48b9-a6b2-bfdf3cc56029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cd9383-a418-48b9-a6b2-bfdf3cc56029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb95b0d-0786-49c6-ba95-532b721a5587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ffed06cf4346fa997660076a00c191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:23Z,use_quota=True,user_id='43314db2b6ce4b8096cb00c0327ef9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9e9dc1-3fd7-480b-8950-8e0472a4b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9e9dc1-3fd7-480b-8950-8e0472a4b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5125fbd6-464b-4953-87bf-efcf1c7c172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5125fbd6-464b-4953-87bf-efcf1c7c172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb95b0d-0786-49c6-ba95-532b721a5587', 'volume_name': 'volume-ffb95b0d-0786-49c6-ba95-532b721a5587', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0f7353-d944-4eae-bb15-51886d59681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0f7353-d944-4eae-bb15-51886d59681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc06d49-5e17-43b3-87ea-4bd5c5c5cc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Volume ffb95b0d-0786-49c6-ba95-532b721a5587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb95b0d-0786-49c6-ba95-532b721a5587', 'volume_size': 1} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:23 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb95b0d-0786-49c6-ba95-532b721a5587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ffed06cf4346fa997660076a00c191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:23Z,use_quota=True,user_id='43314db2b6ce4b8096cb00c0327ef9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Creating volume ffb95b0d-0786-49c6-ba95-532b721a5587 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:23 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:23 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7d1c23b0-8230-4213-ba9c-c66df39ca098" returned: 0 in 0.310s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:23 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 1073741824 Sep 02 16:26:23 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b4ff14-b8a7-4ab5-831a-4e84fd089ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f058776-99b7-488a-875d-3919185d680a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f1aa5e-a17a-406e-9b62-eba5c7578893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "cinder-quobyte-7d1c23b0-8230-4213-ba9c-c66df39ca098" released by "delete_volume" :: held 0.888s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Volume volume-4f058776-99b7-488a-875d-3919185d680a (4f058776-99b7-488a-875d-3919185d680a): created successfully Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f1aa5e-a17a-406e-9b62-eba5c7578893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Flow 'volume_create_manager' (74798150-3d8c-4f9a-b76d-60ad098838ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8e929f6d-1400-46ec-bef7-8eec5206c4df tempest-GroupSnapshotsTest-1835411034 None] Created volume successfully. Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Created reservations ['ba341e5b-eb9d-451d-a0de-49ad720099e2', '7a13f9b6-4434-4a3a-8178-6d4e2ed2a5aa', '83c900e2-806a-40cc-b792-eb7948b39541', '88089359-d093-4416-b891-b04c9d0fa45e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:23 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:23 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:24 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.380s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Deleted volume successfully. Sep 02 16:26:24 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 1073741824" returned: 0 in 0.644s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f82a0df5-b17e-44d9-8829-3175e4592fe7 tempest-VolumesTestJSON-502605218 None] Lock "cinder-7d1c23b0-8230-4213-ba9c-c66df39ca098-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:24 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 Sep 02 16:26:24 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:24 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc06d49-5e17-43b3-87ea-4bd5c5c5cc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb95b0d-0786-49c6-ba95-532b721a5587', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42f5cd2-800f-4d81-824c-b33539b42f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:24 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Volume volume-ffb95b0d-0786-49c6-ba95-532b721a5587 (ffb95b0d-0786-49c6-ba95-532b721a5587): created successfully Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42f5cd2-800f-4d81-824c-b33539b42f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Flow 'volume_create_manager' (a9ea977e-19da-46a6-aa15-eba5474b1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d7539184-0691-47e0-83ce-cc5734075d62 tempest-VolumesListAdminTestJSON-1482355776 None] Created volume successfully. Sep 02 16:26:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] GroupSnapshot 547dd721-2f23-408c-9709-99b47f542e49: creating. Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Group snapshot 547dd721-2f23-408c-9709-99b47f542e49: creating. {{(pid=87051) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Creating offline snapshot 88ae0a0f-85f8-40d8-98e3-369faed61754 of volume 4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc913880-6951-4576-b9df-b6a7acb19ba1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:25 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a Sep 02 16:26:25 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Acquiring lock "cinder-ffb95b0d-0786-49c6-ba95-532b721a5587-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "cinder-ffb95b0d-0786-49c6-ba95-532b721a5587-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Acquiring lock "cinder-quobyte-ffb95b0d-0786-49c6-ba95-532b721a5587" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "cinder-quobyte-ffb95b0d-0786-49c6-ba95-532b721a5587" acquired by "delete_volume" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df110093-03e8-4bf8-8567-f781a6695b60]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-b6001c2c-b428-483b-8e9c-edec824fb43f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-b6001c2c-b428-483b-8e9c-edec824fb43f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:26 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a" returned: 0 in 0.939s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:26 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 Sep 02 16:26:26 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-quobyte-b6001c2c-b428-483b-8e9c-edec824fb43f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-b6001c2c-b428-483b-8e9c-edec824fb43f" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:26 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 1G Sep 02 16:26:26 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[99789d8d-5d6d-4e5a-b53b-35b36a2e73e0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:26 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f Sep 02 16:26:26 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:26 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587" returned: 0 in 0.682s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:27 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587 Sep 02 16:26:27 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:27 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 1G" returned: 0 in 0.652s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f058776-99b7-488a-875d-3919185d680a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:27 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f058776-99b7-488a-875d-3919185d680a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 Sep 02 16:26:27 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:27 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f" returned: 0 in 0.637s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:27 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f Sep 02 16:26:27 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:27 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ffb95b0d-0786-49c6-ba95-532b721a5587" returned: 0 in 0.485s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "cinder-quobyte-ffb95b0d-0786-49c6-ba95-532b721a5587" released by "delete_volume" :: held 1.357s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Created reservations ['e4cbc4cc-4eb7-4661-a80d-c1a488e947d4', '236514dc-cd5b-42ad-94fa-f8a4d28fe9fc', '8c35802c-d5e4-409b-9241-ff453928c37b', 'f29177c1-9f76-4b27-b69b-6934f7a82e9c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:27 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f058776-99b7-488a-875d-3919185d680a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754" returned: 0 in 0.679s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:27 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:27 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 Sep 02 16:26:27 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:27 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:27 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:28 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b6001c2c-b428-483b-8e9c-edec824fb43f" returned: 0 in 0.856s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-b6001c2c-b428-483b-8e9c-edec824fb43f" released by "delete_volume" :: held 1.574s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Created reservations ['59b4415d-e83d-4aac-a4dd-0059249efb81', 'f6caccbc-b0d1-40aa-b663-8fbb83347ad6', '8467fa74-9795-4cb2-ad16-4326a7534fee', 'd3214caa-6dd3-4fd6-bd49-4c0390c23e58'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:28 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754" returned: 0 in 0.507s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:28 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.465s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Deleted volume successfully. Sep 02 16:26:28 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info Sep 02 16:26:28 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92fc9142-0a45-47b1-a208-7e67ae425328 tempest-VolumesListAdminTestJSON-1482355776 None] Lock "cinder-ffb95b0d-0786-49c6-ba95-532b721a5587-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:28 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:28 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:28 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:28 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:28 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Deleted volume successfully. Sep 02 16:26:28 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2006be5d-0dfa-4dbc-9169-674975b29b5f tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-b6001c2c-b428-483b-8e9c-edec824fb43f-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:28 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-quobyte-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf32f4f-fd19-4b16-aa62-cbd66c002cc5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:29 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.info" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.769s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:29 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 Sep 02 16:26:29 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4dfd4c11-c4e6-4262-8487-3ebd97ba422a tempest-GroupSnapshotsTest-1835411034 None] group_snapshot 547dd721-2f23-408c-9709-99b47f542e49: created successfully Sep 02 16:26:29 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" returned: 0 in 0.651s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:29 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1 Sep 02 16:26:29 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:30 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" returned: 0 in 0.447s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:30 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] group_snapshot 547dd721-2f23-408c-9709-99b47f542e49: deleting Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1" released by "delete_volume" :: held 1.176s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] group_snapshot 547dd721-2f23-408c-9709-99b47f542e49: deleting {{(pid=87051) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-88ae0a0f-85f8-40d8-98e3-369faed61754" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Created reservations ['ede4f6b8-7b76-4884-8a81-aac6fbb28ec1', '633cb27e-5bb2-4818-82fd-eb1f9eae5dd4', '79ab1bca-3655-475a-ac2d-8d02be254c51', 'b742b506-f1ef-47d4-ae6c-0a4537326abf'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-88ae0a0f-85f8-40d8-98e3-369faed61754" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Deleting offline snapshot 88ae0a0f-85f8-40d8-98e3-369faed61754 of volume 4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] snapshot_file for this snap is: volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1a9b6-dbed-4ea4-acb8-2ce10771845e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:30 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 Sep 02 16:26:30 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:30 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:30 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:31 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Deleted volume successfully. Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7029473f-6b0f-4eac-8ff4-8949ed8d5f76 tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-b1e2d2c5-01b7-4f9b-bf9a-9b931f1f87a1-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:31 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754" returned: 0 in 0.818s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f058776-99b7-488a-875d-3919185d680a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cae3c0-b9ef-4654-b4e3-8d985035048a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-15149fe0-10ff-48a6-abfd-23a7cf541746-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-15149fe0-10ff-48a6-abfd-23a7cf541746-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "cinder-quobyte-15149fe0-10ff-48a6-abfd-23a7cf541746" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-15149fe0-10ff-48a6-abfd-23a7cf541746" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201b354-b4be-4158-9683-5bd14970fff1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:31 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a Sep 02 16:26:31 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:31 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 Sep 02 16:26:31 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:32 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a" returned: 0 in 0.888s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:32 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746" returned: 0 in 0.667s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:32 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 Sep 02 16:26:32 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:32 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746 Sep 02 16:26:32 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:32 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-15149fe0-10ff-48a6-abfd-23a7cf541746" returned: 0 in 0.577s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-quobyte-15149fe0-10ff-48a6-abfd-23a7cf541746" released by "delete_volume" :: held 1.315s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:32 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754" returned: 0 in 0.669s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:33 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754 Sep 02 16:26:33 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Created reservations ['b143edff-8883-4437-9a4b-843aaee05efa', 'ef126bbb-03e8-4319-b300-9cfc631991a2', '4b93a198-8150-4aa7-b66c-2a5524617439', '4abd963d-22d0-4792-a43e-1a776678dab5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:33 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:33 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:33 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a.88ae0a0f-85f8-40d8-98e3-369faed61754" returned: 0 in 0.390s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-88ae0a0f-85f8-40d8-98e3-369faed61754" released by "_delete_snapshot" :: held 2.991s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" released by "delete_snapshot" :: held 3.050s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:33 devstack cinder-volume[87051]: WARNING cinder.quota [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-70208002 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-70208002, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:33 devstack cinder-volume[87051]: WARNING cinder.quota [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-70208002 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-70208002, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:33 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Deleted volume successfully. Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['25eb178d-8aca-4eb2-8419-2f28949985dc', '26c24650-811b-4104-974f-e857e4295892', '069116a8-a471-4521-a6cf-aab9d97ece47', '88dab584-6b98-42a1-8ba0-5d1abfea2d5b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-50f02fff-42af-4cd3-9016-2237066b854d tempest-VolumesListAdminTestJSON-35826402 None] Lock "cinder-15149fe0-10ff-48a6-abfd-23a7cf541746-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bc315511-af77-4f08-a67b-3aac9f5dfa18 tempest-GroupSnapshotsTest-1835411034 None] group_snapshot 547dd721-2f23-408c-9709-99b47f542e49: deleted successfully Sep 02 16:26:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:35 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572c2c2-4389-4694-9df7-3c798a9848dd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:36 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a Sep 02 16:26:36 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:36 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a" returned: 0 in 0.671s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:36 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a Sep 02 16:26:36 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:36 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4f058776-99b7-488a-875d-3919185d680a" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Lock "cinder-quobyte-4f058776-99b7-488a-875d-3919185d680a" released by "delete_volume" :: held 1.146s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['0d12a3db-6c11-46cd-9dae-6e735c2cf254'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:37 devstack cinder-volume[87051]: WARNING cinder.quota [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-70208002 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-70208002, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Created reservations ['22abf60c-30d5-486f-977c-2c2e27823a59', 'c304dd43-1032-4fff-9c66-70f97e274b6a', '7efb64b6-5d09-478f-bc31-3f3d9ac65295', 'cf2d17b2-6c70-407e-9cb3-ad75770fa8d9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:37 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:37 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:37 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae45f6fb-0555-41c0-9984-6d2cc0d7d2e2 tempest-GroupSnapshotsTest-1835411034 None] Delete group completed successfully. Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Flow 'volume_create_manager' (dcd90715-98fd-47ad-accf-9acbf8b6986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2703c965-f243-43c9-b5b3-0d3c00ba66c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2703c965-f243-43c9-b5b3-0d3c00ba66c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1074367482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be00355-308b-4c50-b696-d24c8398b3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da2aa27bdfb4b14bc17b7c113133539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:47Z,use_quota=True,user_id='4c5c9dee06dd42e187dd78bef9ff7b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f10d81-b6a9-4255-87bc-b64f46ff6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f10d81-b6a9-4255-87bc-b64f46ff6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c22ce2-6552-4c52-9797-c6a982d4344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:26:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4888b4be-b239-4db6-b669-29dfa7b236e5 tempest-GroupsV320Test-252679851 None] Group tempest-GroupsV320Test-Group-1391495101: creating Sep 02 16:26:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4888b4be-b239-4db6-b669-29dfa7b236e5 tempest-GroupsV320Test-252679851 None] Group tempest-GroupsV320Test-Group-1391495101: created successfully Sep 02 16:26:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4888b4be-b239-4db6-b669-29dfa7b236e5 tempest-GroupsV320Test-252679851 None] Create group completed successfully. Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c22ce2-6552-4c52-9797-c6a982d4344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9be00355-308b-4c50-b696-d24c8398b3bd', 'volume_name': 'volume-9be00355-308b-4c50-b696-d24c8398b3bd', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50ab785-24ed-472a-82e4-9157b9f58f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50ab785-24ed-472a-82e4-9157b9f58f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387d117c-6077-4d75-b439-e2b6090143f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Volume 9be00355-308b-4c50-b696-d24c8398b3bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9be00355-308b-4c50-b696-d24c8398b3bd', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 16:26:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Trying to clone 9be00355-308b-4c50-b696-d24c8398b3bd from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:26:48 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Image download 20.69 MB at 20.69 MB/s Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da286e3b-2215-4c79-881f-0b8e7c2b3a49]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:48 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD Sep 02 16:26:48 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:48 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd is fetched for user 4c5c9dee06dd42e187dd78bef9ff7b39. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b9d2f-b559-4d77-847e-253a65a7aba9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:48 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD Sep 02 16:26:48 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:48 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:48 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:48 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1074367482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be00355-308b-4c50-b696-d24c8398b3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da2aa27bdfb4b14bc17b7c113133539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:47Z,use_quota=True,user_id='4c5c9dee06dd42e187dd78bef9ff7b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Creating volume 9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:48 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:48 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1073741824 Sep 02 16:26:48 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:48 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:26:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Created reservations ['88c1413f-bb41-41fd-a094-51655344af24'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:49 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:49 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:49 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1073741824" returned: 0 in 0.518s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:49 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd Sep 02 16:26:49 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:49 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e1dabc7e-116a-4edb-9082-760778249a96 tempest-GroupsV320Test-252679851 None] Delete group completed successfully. Sep 02 16:26:49 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Attempting download of e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 9be00355-308b-4c50-b696-d24c8398b3bd. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fc4a86-1806-4713-9425-b68ac2580759]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:49 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j Sep 02 16:26:49 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:50 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j" returned: 0 in 0.338s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:50 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j Sep 02 16:26:50 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:50 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j" returned: 1 in 0.361s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_bgjxua8j' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a40b5-0dd3-440e-a963-be118968a978]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:50 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD Sep 02 16:26:50 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Flow 'volume_create_manager' (dfd46554-21f3-44b7-b241-b3ba383896f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee991f8-ac65-4f48-8965-71d0c6f9f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee991f8-ac65-4f48-8965-71d0c6f9f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-828722402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc21525a-3638-4108-bdf8-51e2cde271bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c1c1f3b194ff2852f272a884f624e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:51Z,use_quota=True,user_id='9a1674c05b80411b8c08a6b97d3224f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35cea4a-c9f9-4cf4-832d-a3b412bc6971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35cea4a-c9f9-4cf4-832d-a3b412bc6971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e83c0c2-9d28-4c20-b4fe-9500c3cb0876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e83c0c2-9d28-4c20-b4fe-9500c3cb0876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc21525a-3638-4108-bdf8-51e2cde271bf', 'volume_name': 'volume-cc21525a-3638-4108-bdf8-51e2cde271bf', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952502de-506c-4c8d-967c-9c2de3e956fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952502de-506c-4c8d-967c-9c2de3e956fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d71dbe-788e-4a2e-a7c1-2edfdb19cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Volume cc21525a-3638-4108-bdf8-51e2cde271bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc21525a-3638-4108-bdf8-51e2cde271bf', 'volume_size': 1} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-828722402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc21525a-3638-4108-bdf8-51e2cde271bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c1c1f3b194ff2852f272a884f624e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:26:51Z,use_quota=True,user_id='9a1674c05b80411b8c08a6b97d3224f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Creating volume cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:26:50 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:50 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:26:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:50 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf 1073741824 Sep 02 16:26:50 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:50 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd Sep 02 16:26:50 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:51 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf 1073741824" returned: 0 in 0.493s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:51 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf Sep 02 16:26:51 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:51 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d71dbe-788e-4a2e-a7c1-2edfdb19cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc21525a-3638-4108-bdf8-51e2cde271bf', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04db1239-32f7-4fae-ab98-8255227518f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Volume volume-cc21525a-3638-4108-bdf8-51e2cde271bf (cc21525a-3638-4108-bdf8-51e2cde271bf): created successfully Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04db1239-32f7-4fae-ab98-8255227518f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Flow 'volume_create_manager' (dfd46554-21f3-44b7-b241-b3ba383896f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0bfb3c45-e8e0-4bb8-bc92-cf4e4a6bd75d tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Created volume successfully. Sep 02 16:26:52 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd" returned: 0 in 2.124s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:52 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_me90lzqzdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:26:52 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Converted 112.00 MB image at 52.69 MB/s Sep 02 16:26:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:53 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1G Sep 02 16:26:53 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Creating offline snapshot 86001b24-9b2b-4c51-b3fb-e9c8d07becfb of volume cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1ca59-fb63-4a81-90e7-bf8b35917c3d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:53 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf Sep 02 16:26:53 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:53 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd 1G" returned: 0 in 0.453s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Downloaded image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 9be00355-308b-4c50-b696-d24c8398b3bd successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd for user 4c5c9dee06dd42e187dd78bef9ff7b39 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Marking volume 9be00355-308b-4c50-b696-d24c8398b3bd as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Copying metadata from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd to 9be00355-308b-4c50-b696-d24c8398b3bd. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Creating volume glance metadata for volume 9be00355-308b-4c50-b696-d24c8398b3bd backed by image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387d117c-6077-4d75-b439-e2b6090143f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be00355-308b-4c50-b696-d24c8398b3bd', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2c9a46-68e1-44ce-9172-73a30244408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:26:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Volume volume-9be00355-308b-4c50-b696-d24c8398b3bd (9be00355-308b-4c50-b696-d24c8398b3bd): created successfully Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2c9a46-68e1-44ce-9172-73a30244408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Flow 'volume_create_manager' (dcd90715-98fd-47ad-accf-9acbf8b6986b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:26:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9184835d-b6dd-4e19-b655-4eba1ed30937 tempest-VolumesImageMetadata-10839955 None] Created volume successfully. Sep 02 16:26:53 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf" returned: 0 in 0.499s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:53 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb 1G Sep 02 16:26:53 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:54 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb 1G" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc21525a-3638-4108-bdf8-51e2cde271bf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:54 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc21525a-3638-4108-bdf8-51e2cde271bf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb Sep 02 16:26:54 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:54 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc21525a-3638-4108-bdf8-51e2cde271bf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb" returned: 0 in 0.342s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:54 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb is being set with open permissions: ugo+rw Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:54 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb Sep 02 16:26:54 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:54 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:54 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info Sep 02 16:26:54 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:55 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info" returned: 0 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:55 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info is being set with open permissions: ugo+rw Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:55 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info Sep 02 16:26:55 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Acquiring lock "cinder-9be00355-308b-4c50-b696-d24c8398b3bd-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "cinder-9be00355-308b-4c50-b696-d24c8398b3bd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Acquiring lock "cinder-quobyte-9be00355-308b-4c50-b696-d24c8398b3bd" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "cinder-quobyte-9be00355-308b-4c50-b696-d24c8398b3bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[837db64f-7301-4eb5-bc1f-fc8cf2fb5f0b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:55 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.info" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:55 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd Sep 02 16:26:55 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-573cda54-5718-4e01-bd24-640612738000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Create snapshot completed successfully Sep 02 16:26:55 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd" returned: 0 in 0.440s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:55 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd Sep 02 16:26:55 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:56 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9be00355-308b-4c50-b696-d24c8398b3bd" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "cinder-quobyte-9be00355-308b-4c50-b696-d24c8398b3bd" released by "delete_volume" :: held 0.759s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Created reservations ['9a2d9efe-add2-425c-9444-25a3681b0094', '665aa701-8634-441b-a64b-ec4ef1e383dc', 'e5a2d97d-0059-4c88-acae-e7081ed20610', '2416ec0c-f1c5-416a-a240-6dc57395721b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:56 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:26:56 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-43dbdac5-3813-449d-a5ba-d04f61d36129 req-d1f98a17-1e68-4457-9a3d-eeecde243a75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-43dbdac5-3813-449d-a5ba-d04f61d36129 req-d1f98a17-1e68-4457-9a3d-eeecde243a75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-43dbdac5-3813-449d-a5ba-d04f61d36129 req-d1f98a17-1e68-4457-9a3d-eeecde243a75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-43dbdac5-3813-449d-a5ba-d04f61d36129 req-d1f98a17-1e68-4457-9a3d-eeecde243a75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b3dc2bf-99b1-468a-b7db-006c02bd5347', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:26:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-43dbdac5-3813-449d-a5ba-d04f61d36129 req-d1f98a17-1e68-4457-9a3d-eeecde243a75 tempest-TestInstancesWithCinderVolumes-1916189969 None] attachment_update completed successfully. Sep 02 16:26:56 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.355s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:26:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Deleted volume successfully. Sep 02 16:26:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5607f2e3-afcd-4548-ad37-73af9e52069a tempest-VolumesImageMetadata-10839955 None] Lock "cinder-9be00355-308b-4c50-b696-d24c8398b3bd-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "cinder-86001b24-9b2b-4c51-b3fb-e9c8d07becfb-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-86001b24-9b2b-4c51-b3fb-e9c8d07becfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "cinder-quobyte-86001b24-9b2b-4c51-b3fb-e9c8d07becfb" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-86001b24-9b2b-4c51-b3fb-e9c8d07becfb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Deleting offline snapshot 86001b24-9b2b-4c51-b3fb-e9c8d07becfb of volume cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] snapshot_file for this snap is: volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f186c-b3a2-4c34-b734-e65861930e9f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:57 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb Sep 02 16:26:57 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:57 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb" returned: 0 in 0.470s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc21525a-3638-4108-bdf8-51e2cde271bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f7087c-20bb-4525-9c93-852704460fcb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:57 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf Sep 02 16:26:57 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:58 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:58 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb Sep 02 16:26:58 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:58 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb" returned: 0 in 0.536s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:58 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb Sep 02 16:26:58 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:58 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf.86001b24-9b2b-4c51-b3fb-e9c8d07becfb" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-86001b24-9b2b-4c51-b3fb-e9c8d07becfb" released by "_delete_snapshot" :: held 1.841s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" released by "delete_snapshot" :: held 1.875s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:58 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Created reservations ['17794a69-2a0b-4d14-8cfd-ddc2e0f22db7', 'b2764dea-1443-47a5-953c-25f4ec5d8d94', '8fbd42e7-c811-487f-9389-976db378835e', '14bb4fa5-e623-474b-9a04-45b24491440c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:26:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Delete snapshot completed successfully. Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-94166ce6-478f-4101-9f23-28f00dcb978b tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-86001b24-9b2b-4c51-b3fb-e9c8d07becfb-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "cinder-cc21525a-3638-4108-bdf8-51e2cde271bf-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-cc21525a-3638-4108-bdf8-51e2cde271bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b885c87-b820-41d0-99c9-a87cdcbd690c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:59 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf Sep 02 16:26:59 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0422245c-be41-415b-a49a-4fc5a10853ea req-8e54cf3c-8d11-4bdd-8a09-3b60827fae75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0422245c-be41-415b-a49a-4fc5a10853ea req-8e54cf3c-8d11-4bdd-8a09-3b60827fae75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-0422245c-be41-415b-a49a-4fc5a10853ea req-8e54cf3c-8d11-4bdd-8a09-3b60827fae75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-0422245c-be41-415b-a49a-4fc5a10853ea req-8e54cf3c-8d11-4bdd-8a09-3b60827fae75 tempest-TestInstancesWithCinderVolumes-1916189969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-e1308725-1703-4a12-921f-c4948f80d700', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ec84da9-6ca0-4737-8ab6-c82509d26fd2', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:26:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-0422245c-be41-415b-a49a-4fc5a10853ea req-8e54cf3c-8d11-4bdd-8a09-3b60827fae75 tempest-TestInstancesWithCinderVolumes-1916189969 None] attachment_update completed successfully. Sep 02 16:26:59 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:26:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:26:59 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf Sep 02 16:26:59 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:00 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc21525a-3638-4108-bdf8-51e2cde271bf" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-quobyte-cc21525a-3638-4108-bdf8-51e2cde271bf" released by "delete_volume" :: held 0.862s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Created reservations ['1947be52-5928-432a-ab8d-8514dfa831a9', 'a3ca9576-3c5c-43ad-9405-3d6c5e2c0d17', 'f5079b0e-0525-4c60-961b-22928a57977a', '45405849-ea70-4fc2-870a-b203a0282c33'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:00 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:00 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:00 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.469s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Deleted volume successfully. Sep 02 16:27:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cea64f1b-add8-47af-8354-54293604262a tempest-VolumeSnapshotQuotasNegativeTestJSON-1470672452 None] Lock "cinder-cc21525a-3638-4108-bdf8-51e2cde271bf-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Flow 'volume_create_manager' (ba4937d2-3d02-43e6-a30c-22fd32748f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6a92d5-8dd9-41e8-b1fa-61cebc2994e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6a92d5-8dd9-41e8-b1fa-61cebc2994e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-625249144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d29747-009c-431e-b16b-b5027cf72f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a7ca26600f46598660a6dc7eb1e691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:04Z,use_quota=True,user_id='8dd582168d354338996c385d2b0499b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9b7fd-e962-4dea-9a9b-473a6ac9dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9b7fd-e962-4dea-9a9b-473a6ac9dec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b089417-becb-46ef-b967-73d399c9b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b089417-becb-46ef-b967-73d399c9b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d29747-009c-431e-b16b-b5027cf72f17', 'volume_name': 'volume-55d29747-009c-431e-b16b-b5027cf72f17', 'volume_size': 2}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5b3725-a040-4681-894c-4fcff45a5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5b3725-a040-4681-894c-4fcff45a5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dab6f9-b2d8-4018-babd-517494a7e7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Volume 55d29747-009c-431e-b16b-b5027cf72f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d29747-009c-431e-b16b-b5027cf72f17', 'volume_size': 2} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-625249144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d29747-009c-431e-b16b-b5027cf72f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a7ca26600f46598660a6dc7eb1e691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:04Z,use_quota=True,user_id='8dd582168d354338996c385d2b0499b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Creating volume 55d29747-009c-431e-b16b-b5027cf72f17 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:04 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 2147483648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:04 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 2147483648 Sep 02 16:27:04 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:04 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 2147483648" returned: 0 in 0.620s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:04 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 Sep 02 16:27:04 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:05 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dab6f9-b2d8-4018-babd-517494a7e7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d29747-009c-431e-b16b-b5027cf72f17', 'volume_size': 2}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f55cd3d-f329-4f37-b18e-396cbca6bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Volume volume-55d29747-009c-431e-b16b-b5027cf72f17 (55d29747-009c-431e-b16b-b5027cf72f17): created successfully Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f55cd3d-f329-4f37-b18e-396cbca6bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Flow 'volume_create_manager' (ba4937d2-3d02-43e6-a30c-22fd32748f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-95959418-2d24-4af3-8e0f-c0bb3416873d tempest-VolumesCloneNegativeTest-1607023852 None] Created volume successfully. Sep 02 16:27:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-62667e23-1afa-4db5-ac68-ab21a3c34b9d req-9b1946ce-dc4e-4d77-aed2-0abc57c8ff49 tempest-TestInstancesWithCinderVolumes-1916189969 None] Terminate volume connection completed successfully. Sep 02 16:27:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-62667e23-1afa-4db5-ac68-ab21a3c34b9d req-9b1946ce-dc4e-4d77-aed2-0abc57c8ff49 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleting attachment 8b3dc2bf-99b1-468a-b7db-006c02bd5347. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-quobyte-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc25d15d-5a41-49dc-8814-a596c49d5f78]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Acquiring lock "cinder-55d29747-009c-431e-b16b-b5027cf72f17-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "cinder-55d29747-009c-431e-b16b-b5027cf72f17-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:06 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 Sep 02 16:27:06 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Acquiring lock "cinder-quobyte-55d29747-009c-431e-b16b-b5027cf72f17" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "cinder-quobyte-55d29747-009c-431e-b16b-b5027cf72f17" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5989c181-34c8-4aea-8b38-bb198902d627]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:06 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 Sep 02 16:27:06 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:06 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" returned: 0 in 0.548s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:07 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59 Sep 02 16:27:07 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:07 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:07 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17" returned: 0 in 0.671s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59" released by "delete_volume" :: held 1.009s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:07 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17 Sep 02 16:27:07 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:07 devstack cinder-volume[87051]: WARNING cinder.quota [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267792393-1526705887 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267792393-1526705887, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:07 devstack cinder-volume[87051]: WARNING cinder.quota [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267792393-1526705887 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267792393-1526705887, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Created reservations ['2839ed11-ee60-4b96-9081-000219d51fed', 'ac0413e3-9c25-41d6-8038-b5784f5627ce', 'a555421a-2486-47a0-8253-a6d721388b45', '576bdd3e-ed96-4495-bed6-b1a8c31a8d82'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:07 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:07 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:07 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-55d29747-009c-431e-b16b-b5027cf72f17" returned: 0 in 0.414s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "cinder-quobyte-55d29747-009c-431e-b16b-b5027cf72f17" released by "delete_volume" :: held 1.156s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Created reservations ['192fc010-8f60-4e9a-9801-3ebf6f301e3e', 'eead8162-9552-4dca-9858-b8e02add8497', 'b43f04ae-485d-417f-841a-62e54396e1ed', 'a34c4778-5f9b-4b9b-9351-0acdc89da151'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:07 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.438s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:07 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleted volume successfully. Sep 02 16:27:08 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:08 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f07eb4cc-781d-46aa-b04f-593fe938c781 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-7c68d126-e7eb-49b0-b5e7-9925d4ea7c59-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:08 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.309s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:08 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Deleted volume successfully. Sep 02 16:27:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1f05afc1-b4c1-4f81-9ff5-3edb7a98b541 tempest-VolumesCloneNegativeTest-1607023852 None] Lock "cinder-55d29747-009c-431e-b16b-b5027cf72f17-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-2258753b-e56a-4229-8cf5-550a8aeff134 req-a3c6273c-91eb-4438-b615-103846b0cee3 tempest-TestInstancesWithCinderVolumes-1916189969 None] Terminate volume connection completed successfully. Sep 02 16:27:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-2258753b-e56a-4229-8cf5-550a8aeff134 req-a3c6273c-91eb-4438-b615-103846b0cee3 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleting attachment 9ec84da9-6ca0-4737-8ab6-c82509d26fd2. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:27:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-e1308725-1703-4a12-921f-c4948f80d700-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-e1308725-1703-4a12-921f-c4948f80d700-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-quobyte-e1308725-1703-4a12-921f-c4948f80d700" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-e1308725-1703-4a12-921f-c4948f80d700" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e39d845-a4d1-4507-a1c9-789408e369fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:12 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 Sep 02 16:27:12 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:12 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700" returned: 0 in 0.562s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:12 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700 Sep 02 16:27:12 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:13 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e1308725-1703-4a12-921f-c4948f80d700" returned: 0 in 0.427s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-e1308725-1703-4a12-921f-c4948f80d700" released by "delete_volume" :: held 1.059s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:13 devstack cinder-volume[87051]: WARNING cinder.quota [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724529905-1679629668 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724529905-1679629668, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:13 devstack cinder-volume[87051]: WARNING cinder.quota [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724529905-1679629668 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724529905-1679629668, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Created reservations ['3d3d52c4-89e0-4cfa-8bc7-26595f07f171', 'd119b2b1-63f2-442e-ba75-b2b615bf3a15', 'f8bef296-7442-4816-9224-6bbf6818eb80', 'c3166ef6-55b2-4ac3-8ad4-55fa54c0d12f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:13 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:13 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:13 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleted volume successfully. Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=180,cinder:INSERT=58,cinder:UPDATE=192,cinder:DELETE=18 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:27:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-0b7186ce-99ec-492d-9300-31db65725ce2 tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-e1308725-1703-4a12-921f-c4948f80d700-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=173,cinder:UPDATE=205,cinder:DELETE=7,cinder:INSERT=55 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Flow 'volume_create_manager' (261f33ed-fef2-4318-9dc6-81a8c2167fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114cc934-144f-4108-897e-04111a116baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114cc934-144f-4108-897e-04111a116baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1998233878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c349c-6d49-4f62-8a06-6c9919654550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af06cb28574679b25119ea5823178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:16Z,use_quota=True,user_id='aba0052d4215458f96f857d045500fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a2c07d-2e7f-4042-a07a-131e5a3ec8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a2c07d-2e7f-4042-a07a-131e5a3ec8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58082f07-6668-4c36-9df4-85334766b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58082f07-6668-4c36-9df4-85334766b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174c349c-6d49-4f62-8a06-6c9919654550', 'volume_name': 'volume-174c349c-6d49-4f62-8a06-6c9919654550', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c0f8dd-3074-44fd-902a-aa0b8e93f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c0f8dd-3074-44fd-902a-aa0b8e93f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddd34f9-a9b1-49aa-8d19-d1891fc396cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume 174c349c-6d49-4f62-8a06-6c9919654550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174c349c-6d49-4f62-8a06-6c9919654550', 'volume_size': 1} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1998233878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c349c-6d49-4f62-8a06-6c9919654550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af06cb28574679b25119ea5823178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:16Z,use_quota=True,user_id='aba0052d4215458f96f857d045500fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Creating volume 174c349c-6d49-4f62-8a06-6c9919654550 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:16 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 1073741824 Sep 02 16:27:16 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:16 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 1073741824" returned: 0 in 0.520s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:16 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 Sep 02 16:27:16 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:17 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550" returned: 0 in 0.365s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddd34f9-a9b1-49aa-8d19-d1891fc396cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174c349c-6d49-4f62-8a06-6c9919654550', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a94b8f-c6a9-4de9-98f0-82cf096eaf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume volume-174c349c-6d49-4f62-8a06-6c9919654550 (174c349c-6d49-4f62-8a06-6c9919654550): created successfully Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a94b8f-c6a9-4de9-98f0-82cf096eaf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Flow 'volume_create_manager' (261f33ed-fef2-4318-9dc6-81a8c2167fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9a863a80-dd08-496f-9548-db2d3db2f2c0 tempest-VolumeQuotasAdminTestJSON-257280600 None] Created volume successfully. Sep 02 16:27:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "cinder-174c349c-6d49-4f62-8a06-6c9919654550-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "cinder-174c349c-6d49-4f62-8a06-6c9919654550-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "cinder-quobyte-174c349c-6d49-4f62-8a06-6c9919654550" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "cinder-quobyte-174c349c-6d49-4f62-8a06-6c9919654550" acquired by "delete_volume" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3d3c3-3ec9-47a3-b93c-e24eb3e2823e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:19 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 Sep 02 16:27:19 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:19 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550" returned: 0 in 0.639s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:19 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550 Sep 02 16:27:19 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:20 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-174c349c-6d49-4f62-8a06-6c9919654550" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "cinder-quobyte-174c349c-6d49-4f62-8a06-6c9919654550" released by "delete_volume" :: held 1.129s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Created reservations ['da4aa9c4-15b8-43e3-a3de-d00eb0f85152', '363eb040-7279-443e-bc29-8298a6a1e9b6', '8078889d-7a44-43a7-b1bc-816bf1205b22', '6d8c8e3c-ffcc-4717-9f98-71aec2038be1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:20 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:20 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:20 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Deleted volume successfully. Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b5a36e12-deb7-4e39-9c59-400616b8f254 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "cinder-174c349c-6d49-4f62-8a06-6c9919654550-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Flow 'volume_create_manager' (22976273-c2f3-4b8a-84e8-02fcbd07e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999624df-6d98-4db1-bfd0-87f42756ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999624df-6d98-4db1-bfd0-87f42756ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1523964211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376d9b7e-e006-4bad-a2a5-12f818f79fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3890940c4f914907a5026dc22fa25976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:21Z,use_quota=True,user_id='9626dc61ddfe4dca9c11d87bc982e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec202c58-819e-4353-9859-9cb6d7f6a465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec202c58-819e-4353-9859-9cb6d7f6a465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1b15ae-9c52-4198-88fb-fe861d0a9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1b15ae-9c52-4198-88fb-fe861d0a9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376d9b7e-e006-4bad-a2a5-12f818f79fca', 'volume_name': 'volume-376d9b7e-e006-4bad-a2a5-12f818f79fca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b2f32c-7b61-4713-8844-0efddd731c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b2f32c-7b61-4713-8844-0efddd731c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f481fe2-7d4f-440e-af75-53dbea5b8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Volume 376d9b7e-e006-4bad-a2a5-12f818f79fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376d9b7e-e006-4bad-a2a5-12f818f79fca', 'volume_size': 1} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1523964211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376d9b7e-e006-4bad-a2a5-12f818f79fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3890940c4f914907a5026dc22fa25976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:21Z,use_quota=True,user_id='9626dc61ddfe4dca9c11d87bc982e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Creating volume 376d9b7e-e006-4bad-a2a5-12f818f79fca {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:21 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:21 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca 1073741824 Sep 02 16:27:21 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-3ab55fde-a55a-4daf-a691-a491e10c2c0d req-e7052683-994d-4d29-b0cc-88ecc6427f38 tempest-TestInstancesWithCinderVolumes-1916189969 None] Terminate volume connection completed successfully. Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-3ab55fde-a55a-4daf-a691-a491e10c2c0d req-e7052683-994d-4d29-b0cc-88ecc6427f38 tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleting attachment 67875395-3da5-4982-b418-8e47410570df. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:27:21 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca 1073741824" returned: 0 in 0.713s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:21 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca Sep 02 16:27:21 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Flow 'volume_create_manager' (926178bc-82f4-4cb6-b5dc-8b89a1165f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0fcb43-37a2-40a3-8368-3511922833fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0fcb43-37a2-40a3-8368-3511922833fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-581276506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a26dc81-1e0b-4b3f-9dce-a15cb54a681c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af06cb28574679b25119ea5823178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:22Z,use_quota=True,user_id='aba0052d4215458f96f857d045500fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf69d146-ee03-4953-8498-f975cd507a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf69d146-ee03-4953-8498-f975cd507a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344e22b-10a4-49fb-9dfc-c4d82261b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344e22b-10a4-49fb-9dfc-c4d82261b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a26dc81-1e0b-4b3f-9dce-a15cb54a681c', 'volume_name': 'volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e967c96-fe54-4c74-9ce7-df3e5a59f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e967c96-fe54-4c74-9ce7-df3e5a59f0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7904e39-d27d-4a7f-a801-f05de52d95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:21 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume 6a26dc81-1e0b-4b3f-9dce-a15cb54a681c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c', 'volume_size': 1} Sep 02 16:27:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:22 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca" returned: 0 in 0.315s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-581276506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a26dc81-1e0b-4b3f-9dce-a15cb54a681c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58af06cb28574679b25119ea5823178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:22Z,use_quota=True,user_id='aba0052d4215458f96f857d045500fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Creating volume 6a26dc81-1e0b-4b3f-9dce-a15cb54a681c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f481fe2-7d4f-440e-af75-53dbea5b8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376d9b7e-e006-4bad-a2a5-12f818f79fca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7138ebc2-a7a8-4331-873b-df09cc3173e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:22 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c 1073741824 Sep 02 16:27:22 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-607c253c-266e-43f8-8923-23957fb7a324-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-607c253c-266e-43f8-8923-23957fb7a324-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:22 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Volume volume-376d9b7e-e006-4bad-a2a5-12f818f79fca (376d9b7e-e006-4bad-a2a5-12f818f79fca): created successfully Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7138ebc2-a7a8-4331-873b-df09cc3173e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Flow 'volume_create_manager' (22976273-c2f3-4b8a-84e8-02fcbd07e62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2f0137db-c754-4dbc-ac6e-1121dbf6f53e tempest-VolumesNegativeTest-175710782 None] Created volume successfully. Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "cinder-quobyte-607c253c-266e-43f8-8923-23957fb7a324" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-607c253c-266e-43f8-8923-23957fb7a324" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e3b1b-6722-4ab6-8a33-ae88dcd62af7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:22 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 Sep 02 16:27:22 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:22 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c 1073741824" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:22 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c Sep 02 16:27:22 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:22 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324" returned: 0 in 0.458s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:22 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324 Sep 02 16:27:22 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:23 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" returned: 0 in 0.325s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7904e39-d27d-4a7f-a801-f05de52d95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90568b99-8bb7-40ec-8630-37ae31a358d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Volume volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c (6a26dc81-1e0b-4b3f-9dce-a15cb54a681c): created successfully Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90568b99-8bb7-40ec-8630-37ae31a358d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Flow 'volume_create_manager' (926178bc-82f4-4cb6-b5dc-8b89a1165f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dbc34688-8fe3-4565-ac8b-e1ad54d823a7 tempest-VolumeQuotasAdminTestJSON-257280600 None] Created volume successfully. Sep 02 16:27:23 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-607c253c-266e-43f8-8923-23957fb7a324" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-quobyte-607c253c-266e-43f8-8923-23957fb7a324" released by "delete_volume" :: held 0.787s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:23 devstack cinder-volume[87051]: WARNING cinder.quota [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-836375773-1931383237 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-836375773-1931383237, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:23 devstack cinder-volume[87051]: WARNING cinder.quota [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-836375773-1931383237 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-836375773-1931383237, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Created reservations ['1f5a9490-49b0-4843-8d28-d28ce78e60ea', '607d2a2b-8865-41b9-beb9-07752fe73589', 'bda7208c-c870-4296-9c50-ab913d36d7f0', '53921fcf-8dd5-47c0-ba87-09e70dd612f1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:23 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:23 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:23 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.425s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Deleted volume successfully. Sep 02 16:27:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf1cbbd2-140c-457f-b8e7-c0acc91cfb3a tempest-TestInstancesWithCinderVolumes-1916189969 None] Lock "cinder-607c253c-266e-43f8-8923-23957fb7a324-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-28642181-c617-4d2a-8405-fbe0fda42f1a tempest-VolumeQuotasAdminTestJSON-42963779 None] Transfer volume completed successfully. Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Acquiring lock "cinder-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "cinder-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Acquiring lock "cinder-quobyte-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "cinder-quobyte-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51bd71-0a25-4560-8044-ab15d20de513]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:25 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c Sep 02 16:27:25 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:26 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:26 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c Sep 02 16:27:26 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:26 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" returned: 0 in 0.323s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "cinder-quobyte-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c" released by "delete_volume" :: held 0.811s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Created reservations ['f4c48795-4bcf-449d-ba1f-8c0dcda92f6e', '35d84787-a4ef-4b21-b1a1-7ffdfe627afa', '5391b476-70d4-42a0-bd4e-efba900304cf', '726dd8b6-96bb-4860-86d2-7c5cf7ae9ba1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:26 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:26 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:26 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.297s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:26 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Deleted volume successfully. Sep 02 16:27:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33b40918-8041-487f-ad99-7147e3b017b0 tempest-VolumeQuotasAdminTestJSON-1318925592 None] Lock "cinder-6a26dc81-1e0b-4b3f-9dce-a15cb54a681c-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:36 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=37,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:27:37 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Flow 'volume_create_manager' (91bd59bb-f599-41ab-be37-fa4b5e9bbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f22da6-a51c-48bc-a530-8914995a3500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f22da6-a51c-48bc-a530-8914995a3500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1606889727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a705612b-706e-48e1-8247-b1031530f20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cc3770e94442bfa47c5fcd2aa2dbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:43Z,use_quota=True,user_id='6c900dffb3774eb6bad6afaa82767c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f118e39-4514-45b8-8d21-c0e1b93f664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f118e39-4514-45b8-8d21-c0e1b93f664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fee1a6-a2fb-4e8c-b764-13f27bea5945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fee1a6-a2fb-4e8c-b764-13f27bea5945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a705612b-706e-48e1-8247-b1031530f20d', 'volume_name': 'volume-a705612b-706e-48e1-8247-b1031530f20d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7c593f-4137-45d7-bcbf-c993609874d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7c593f-4137-45d7-bcbf-c993609874d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa8ddba-6591-43fb-a432-f555e0f4d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:43 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Volume a705612b-706e-48e1-8247-b1031530f20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a705612b-706e-48e1-8247-b1031530f20d', 'volume_size': 1} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1606889727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a705612b-706e-48e1-8247-b1031530f20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cc3770e94442bfa47c5fcd2aa2dbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:43Z,use_quota=True,user_id='6c900dffb3774eb6bad6afaa82767c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Creating volume a705612b-706e-48e1-8247-b1031530f20d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:43 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:43 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d 1073741824 Sep 02 16:27:43 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:44 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d 1073741824" returned: 0 in 0.876s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:44 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d Sep 02 16:27:44 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:44 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d" returned: 0 in 0.337s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa8ddba-6591-43fb-a432-f555e0f4d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a705612b-706e-48e1-8247-b1031530f20d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed28465-f01c-439b-b5de-b2adc45cb05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:44 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Volume volume-a705612b-706e-48e1-8247-b1031530f20d (a705612b-706e-48e1-8247-b1031530f20d): created successfully Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed28465-f01c-439b-b5de-b2adc45cb05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Flow 'volume_create_manager' (91bd59bb-f599-41ab-be37-fa4b5e9bbe11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-abacd0cf-c815-4b02-9f5a-194556b8a422 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Created volume successfully. Sep 02 16:27:46 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (d8043559-c96f-4f34-8913-87cc634ff0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c112889-3cf5-434a-838a-d317b0fe33b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c112889-3cf5-434a-838a-d317b0fe33b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-968549394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2890e2-ddd3-430a-a769-5b602f5811e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:47Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2113645a-f318-40de-87f4-26bdeb7c2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2113645a-f318-40de-87f4-26bdeb7c2baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6a655e-092f-41fa-935f-933858de3597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6a655e-092f-41fa-935f-933858de3597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2890e2-ddd3-430a-a769-5b602f5811e3', 'volume_name': 'volume-5a2890e2-ddd3-430a-a769-5b602f5811e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f164e736-7e07-4826-9f3e-00f8ff484925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f164e736-7e07-4826-9f3e-00f8ff484925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20260a4-4c97-4db6-a667-f8cf17f0f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Volume 5a2890e2-ddd3-430a-a769-5b602f5811e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2890e2-ddd3-430a-a769-5b602f5811e3', 'volume_size': 1} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-968549394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2890e2-ddd3-430a-a769-5b602f5811e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:47Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Creating volume 5a2890e2-ddd3-430a-a769-5b602f5811e3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:47 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:47 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 1073741824 Sep 02 16:27:47 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Acquiring lock "cinder-a705612b-706e-48e1-8247-b1031530f20d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "cinder-a705612b-706e-48e1-8247-b1031530f20d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Acquiring lock "cinder-quobyte-a705612b-706e-48e1-8247-b1031530f20d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "cinder-quobyte-a705612b-706e-48e1-8247-b1031530f20d" acquired by "delete_volume" :: waited 0.047s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[18abee69-2c0f-49a2-9b82-9e46e9643838]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (f36f999c-3621-4da0-b7de-4103f85369bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25d5e36-8775-4479-b43b-360c78e4c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25d5e36-8775-4479-b43b-360c78e4c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576175043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e8b515-2cdc-43e1-a9eb-97eac1d0ba84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:48Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0663db8c-70a6-4217-89ea-270ed7b11fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0663db8c-70a6-4217-89ea-270ed7b11fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3d1d47-fe9b-4794-99c8-e2fa62e15d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d Sep 02 16:27:48 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3d1d47-fe9b-4794-99c8-e2fa62e15d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e8b515-2cdc-43e1-a9eb-97eac1d0ba84', 'volume_name': 'volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716cc4a-845d-4c3c-a971-025369d53b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716cc4a-845d-4c3c-a971-025369d53b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33441567-bc50-4752-b6fb-15e700476d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Volume 23e8b515-2cdc-43e1-a9eb-97eac1d0ba84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84', 'volume_size': 1} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:48 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 1073741824" returned: 0 in 1.119s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:48 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 Sep 02 16:27:48 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (e2ac274f-d9ca-410d-bf76-f5b370715155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c850a8-5466-474b-9594-970eeeb96c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c850a8-5466-474b-9594-970eeeb96c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678673562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e31c3ca-e0db-4af6-914e-8767b93448ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:48Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec8565-a357-44a3-ba62-19baec3e60f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec8565-a357-44a3-ba62-19baec3e60f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cd8294-75ba-4e0b-abfe-2dc720b5fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cd8294-75ba-4e0b-abfe-2dc720b5fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e31c3ca-e0db-4af6-914e-8767b93448ac', 'volume_name': 'volume-0e31c3ca-e0db-4af6-914e-8767b93448ac', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753e536-268a-4ab2-bfe4-01d21790e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753e536-268a-4ab2-bfe4-01d21790e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71345173-ca24-4a63-8d9a-0c993c17c5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Volume 0e31c3ca-e0db-4af6-914e-8767b93448ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e31c3ca-e0db-4af6-914e-8767b93448ac', 'volume_size': 1} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:48 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d" returned: 0 in 0.791s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:48 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:48 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:48 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d Sep 02 16:27:48 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3" returned: 0 in 0.480s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:48 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576175043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e8b515-2cdc-43e1-a9eb-97eac1d0ba84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:48Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Creating volume 23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:48 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20260a4-4c97-4db6-a667-f8cf17f0f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2890e2-ddd3-430a-a769-5b602f5811e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17993a1-75ea-404e-bb57-6ad6c42abbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 1073741824 Sep 02 16:27:49 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:49 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Volume volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 (5a2890e2-ddd3-430a-a769-5b602f5811e3): created successfully Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17993a1-75ea-404e-bb57-6ad6c42abbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (d8043559-c96f-4f34-8913-87cc634ff0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5a2dde0d-416d-4c6e-9b7b-699efc2fa439 tempest-CreateVolumesFromImageTest-470158869 None] Created volume successfully. Sep 02 16:27:49 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a705612b-706e-48e1-8247-b1031530f20d" returned: 0 in 0.686s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (cce3f800-85f5-455b-98bd-2102a69bb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb47a81-2a27-4260-bd61-d1053719934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "cinder-quobyte-a705612b-706e-48e1-8247-b1031530f20d" released by "delete_volume" :: held 1.675s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb47a81-2a27-4260-bd61-d1053719934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565381914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:49Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f081941-ba22-40ed-847f-77418a141576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f081941-ba22-40ed-847f-77418a141576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e203db4-fc80-46f9-b80f-14da7827ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e203db4-fc80-46f9-b80f-14da7827ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d', 'volume_name': 'volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ce0b53-111f-494e-8c86-16929ff90ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ce0b53-111f-494e-8c86-16929ff90ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6909683-9fd8-4738-b9e2-ab093d156bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:49 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Volume 6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d', 'volume_size': 1} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.988s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Created reservations ['e144ae29-d453-4568-9b54-72b389e4ffb6', 'd3d3e6ef-f2f6-49f1-b72e-4f0e0b4028d6', 'bbcdf933-f766-4c0a-9c5d-2c7e34107692', '9ac69ff2-7439-4a1c-b267-9238e1dc1bf5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:50 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:50 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:50 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (05444986-55b1-4558-93ab-9bb4710e4374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844d3941-f558-40a7-b7e0-1080da6964a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 1073741824" returned: 0 in 1.414s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844d3941-f558-40a7-b7e0-1080da6964a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021254605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d69dc6-68c2-4153-a0ed-144d29c7934f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:50Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9dcb3c-75d2-42ac-9acd-244c8b26b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9dcb3c-75d2-42ac-9acd-244c8b26b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb2cfd3-89ee-4bec-8bb0-e0691d5a2215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb2cfd3-89ee-4bec-8bb0-e0691d5a2215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d69dc6-68c2-4153-a0ed-144d29c7934f', 'volume_name': 'volume-01d69dc6-68c2-4153-a0ed-144d29c7934f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc284bd-8558-40a2-b0b5-7360b0a7afaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc284bd-8558-40a2-b0b5-7360b0a7afaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0109f8b-e83f-4b4b-9b5e-2ea580bb6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Volume 01d69dc6-68c2-4153-a0ed-144d29c7934f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d69dc6-68c2-4153-a0ed-144d29c7934f', 'volume_size': 1} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:50 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 Sep 02 16:27:50 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:50 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.581s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Deleted volume successfully. Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d97cd64c-45e0-4eeb-98de-a2a2caed4b56 tempest-VolumeQuotasNegativeTestJSON-1502842792 None] Lock "cinder-a705612b-706e-48e1-8247-b1031530f20d-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (e00849c3-a635-4382-941d-41671d623938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073e8dad-20f6-43c9-9a0a-5942f556a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073e8dad-20f6-43c9-9a0a-5942f556a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903725248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d688b509-fd6a-437e-bc10-ccfc002aa8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:51Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ae9d4-c840-4bbe-ba54-eb00421e87fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ae9d4-c840-4bbe-ba54-eb00421e87fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23d14e2-4401-4eed-94d6-f3c723aa7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23d14e2-4401-4eed-94d6-f3c723aa7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd688b509-fd6a-437e-bc10-ccfc002aa8f4', 'volume_name': 'volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db725c4e-973b-40d1-ad11-ff344620467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db725c4e-973b-40d1-ad11-ff344620467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777a9e9e-1bc0-4dbd-bbef-0d7ec46337de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Volume d688b509-fd6a-437e-bc10-ccfc002aa8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4', 'volume_size': 1} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:50 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678673562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e31c3ca-e0db-4af6-914e-8767b93448ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:48Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Creating volume 0e31c3ca-e0db-4af6-914e-8767b93448ac {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33441567-bc50-4752-b6fb-15e700476d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac 1073741824 Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232da14-9d3d-41ad-88ca-81a2ee7c44a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:50 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Volume volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 (23e8b515-2cdc-43e1-a9eb-97eac1d0ba84): created successfully Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232da14-9d3d-41ad-88ca-81a2ee7c44a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (f36f999c-3621-4da0-b7de-4103f85369bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-14741f2a-bcab-4a9f-ac9f-88a5ccfe0df5 tempest-CreateVolumesFromImageTest-470158869 None] Created volume successfully. Sep 02 16:27:51 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac 1073741824" returned: 0 in 0.630s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:51 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac Sep 02 16:27:51 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:51 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565381914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:49Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Creating volume 6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:51 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71345173-ca24-4a63-8d9a-0c993c17c5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e31c3ca-e0db-4af6-914e-8767b93448ac', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:51 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d 1073741824 Sep 02 16:27:51 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ddf670-ad04-4631-bb60-452a14b19cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Volume volume-0e31c3ca-e0db-4af6-914e-8767b93448ac (0e31c3ca-e0db-4af6-914e-8767b93448ac): created successfully Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ddf670-ad04-4631-bb60-452a14b19cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (e2ac274f-d9ca-410d-bf76-f5b370715155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3d1933c5-45d9-4c20-9a2f-5cbe20c49dd0 tempest-CreateVolumesFromImageTest-470158869 None] Created volume successfully. Sep 02 16:27:52 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d 1073741824" returned: 0 in 0.735s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:52 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d Sep 02 16:27:52 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:52 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" returned: 0 in 0.273s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.482s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021254605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d69dc6-68c2-4153-a0ed-144d29c7934f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e0864dada9441894b4970d474e99a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:50Z,use_quota=True,user_id='cc18226354f04afc80d71beb8ebc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Creating volume 01d69dc6-68c2-4153-a0ed-144d29c7934f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:52 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:52 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f 1073741824 Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6909683-9fd8-4738-b9e2-ab093d156bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:52 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729e92cd-74dd-49bd-abfd-edb9760a8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Volume volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d (6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d): created successfully Sep 02 16:27:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729e92cd-74dd-49bd-abfd-edb9760a8730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (cce3f800-85f5-455b-98bd-2102a69bb194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7b7e0c23-6cc3-46d6-9d2c-10116eb257b5 tempest-CreateVolumesFromImageTest-470158869 None] Created volume successfully. Sep 02 16:27:53 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f 1073741824" returned: 0 in 0.678s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:53 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f Sep 02 16:27:53 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:54 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f" returned: 0 in 0.374s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903725248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d688b509-fd6a-437e-bc10-ccfc002aa8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:27:51Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Creating volume d688b509-fd6a-437e-bc10-ccfc002aa8f4 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:27:54 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0109f8b-e83f-4b4b-9b5e-2ea580bb6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d69dc6-68c2-4153-a0ed-144d29c7934f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0ef4cb-a577-4362-83d6-d1fc3ef0320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:54 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 1073741824 Sep 02 16:27:54 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:54 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Volume volume-01d69dc6-68c2-4153-a0ed-144d29c7934f (01d69dc6-68c2-4153-a0ed-144d29c7934f): created successfully Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0ef4cb-a577-4362-83d6-d1fc3ef0320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Flow 'volume_create_manager' (05444986-55b1-4558-93ab-9bb4710e4374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7423c1b2-4081-4789-a75b-406ec6d688e1 tempest-CreateVolumesFromImageTest-470158869 None] Created volume successfully. Sep 02 16:27:54 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 1073741824" returned: 0 in 0.543s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:54 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 Sep 02 16:27:54 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-01d69dc6-68c2-4153-a0ed-144d29c7934f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-01d69dc6-68c2-4153-a0ed-144d29c7934f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-quobyte-01d69dc6-68c2-4153-a0ed-144d29c7934f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-01d69dc6-68c2-4153-a0ed-144d29c7934f" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9455e31-06ac-4e2c-8b83-d7bad24d7d0d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:55 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4" returned: 0 in 0.513s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777a9e9e-1bc0-4dbd-bbef-0d7ec46337de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d2e5fc-cfca-439d-ba2b-aac00a5f6af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:27:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Volume volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 (d688b509-fd6a-437e-bc10-ccfc002aa8f4): created successfully Sep 02 16:27:55 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f Sep 02 16:27:55 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d2e5fc-cfca-439d-ba2b-aac00a5f6af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (e00849c3-a635-4382-941d-41671d623938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:27:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-abcfe821-0d58-4764-9452-b485f079cf99 tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:27:55 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f" returned: 0 in 0.576s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:55 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f Sep 02 16:27:55 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc49d626-a71c-4d22-ae8a-4b593f9f3137 tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4" by "attach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc49d626-a71c-4d22-ae8a-4b593f9f3137 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4" acquired by "attach_volume" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dc49d626-a71c-4d22-ae8a-4b593f9f3137 tempest-VolumesActionsTest-221896770 None] Attaching volume d688b509-fd6a-437e-bc10-ccfc002aa8f4 to instance 39adbb28-e784-4c15-83f2-0736d35de1ef at mountpoint /dev/vdb on host None. Sep 02 16:27:56 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-01d69dc6-68c2-4153-a0ed-144d29c7934f" returned: 0 in 0.495s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dc49d626-a71c-4d22-ae8a-4b593f9f3137 tempest-VolumesActionsTest-221896770 None] Attach volume completed successfully. Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-01d69dc6-68c2-4153-a0ed-144d29c7934f" released by "delete_volume" :: held 1.132s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc49d626-a71c-4d22-ae8a-4b593f9f3137 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4" released by "attach_volume" :: held 0.225s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Created reservations ['2a2cdf7a-a5b4-4497-b47e-3115bf8aa341', '566abf64-67e6-4317-a19c-2492aa2ad174', '2eaa41c7-28bd-4525-a23c-71bdd8e46586', '7570600a-2979-4c5d-a3d8-b70406f5e5cf'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:56 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:56 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:56 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Deleted volume successfully. Sep 02 16:27:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-05fc67c6-2ed3-4d13-87d4-8d12052b2444 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-01d69dc6-68c2-4153-a0ed-144d29c7934f-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Terminate volume connection completed successfully. Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" by "detach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-quobyte-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" acquired by "delete_volume" :: waited 0.059s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Detaching volume d688b509-fd6a-437e-bc10-ccfc002aa8f4 from instance 39adbb28-e784-4c15-83f2-0736d35de1ef. Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa58437-5614-4631-9164-0138c4cdc345]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Detach volume completed successfully. Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fbd847cf-1f33-45a2-8c75-607f008e83e4 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" released by "detach_volume" :: held 0.209s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:57 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d Sep 02 16:27:57 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Acquiring lock "cinder-376d9b7e-e006-4bad-a2a5-12f818f79fca-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "cinder-376d9b7e-e006-4bad-a2a5-12f818f79fca-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c6a5598-6a5e-4212-83e6-293de84960e6 tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" by "detach_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Acquiring lock "cinder-quobyte-376d9b7e-e006-4bad-a2a5-12f818f79fca" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "cinder-quobyte-376d9b7e-e006-4bad-a2a5-12f818f79fca" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c6a5598-6a5e-4212-83e6-293de84960e6 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7c6a5598-6a5e-4212-83e6-293de84960e6 tempest-VolumesActionsTest-221896770 None] Volume detach called, but volume not attached. Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418fe65-774b-47f8-b28f-e0623fd291e9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c6a5598-6a5e-4212-83e6-293de84960e6 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:58 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" returned: 0 in 0.800s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:58 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca Sep 02 16:27:58 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:58 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d Sep 02 16:27:58 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-quobyte-d688b509-fd6a-437e-bc10-ccfc002aa8f4" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "cinder-quobyte-d688b509-fd6a-437e-bc10-ccfc002aa8f4" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[009038b8-2ab0-4518-9411-3dcab93c3806]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:58 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca" returned: 0 in 0.691s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:58 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca Sep 02 16:27:58 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:58 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" returned: 0 in 0.569s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:58 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 Sep 02 16:27:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d" released by "delete_volume" :: held 1.440s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:58 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Created reservations ['218c4783-ff28-4149-80b2-594fe7d7bfd8', '2c2f6e59-67cf-4549-b3da-60d8979e5384', '9268b0a6-a51e-4632-8b7d-614a1c6eb13f', '2fa817ae-82e8-4982-83a1-c89d3449c670'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:59 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:59 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:59 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:59 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-376d9b7e-e006-4bad-a2a5-12f818f79fca" returned: 0 in 0.499s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4" returned: 0 in 0.555s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "cinder-quobyte-376d9b7e-e006-4bad-a2a5-12f818f79fca" released by "delete_volume" :: held 1.290s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:59 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4 Sep 02 16:27:59 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Created reservations ['1d6cb4d2-2fe8-4296-abbf-6a41e2445307', '03e6fac9-93ae-431c-9ce6-e7ab7131800d', '7f8aa220-a137-47a8-8af6-c5ea9aead2c4', '98025836-57ad-40be-9663-c00ad6f25263'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:27:59 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.458s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:27:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Deleted volume successfully. Sep 02 16:27:59 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:27:59 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca12da6b-082f-4419-ad54-c2e8193ba67c tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-6cf042c8-48cf-4fd1-9440-c02fb8a4bf5d-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:59 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d688b509-fd6a-437e-bc10-ccfc002aa8f4" returned: 0 in 0.482s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "cinder-quobyte-d688b509-fd6a-437e-bc10-ccfc002aa8f4" released by "delete_volume" :: held 1.126s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-0e31c3ca-e0db-4af6-914e-8767b93448ac-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:27:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-0e31c3ca-e0db-4af6-914e-8767b93448ac-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-quobyte-0e31c3ca-e0db-4af6-914e-8767b93448ac" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:00 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.384s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-0e31c3ca-e0db-4af6-914e-8767b93448ac" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Deleted volume successfully. Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Created reservations ['e33e872f-881a-46f9-9314-c8a64dc51786', '323c42d8-2084-4aca-9120-62f919c91866', 'ac0d177f-150a-4fa0-a45e-b67f73b66f08', '55eb30df-52ea-49dc-9d7f-a52ece59e2f7'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c81dda-081f-4e80-8bb9-b6bd88c5d093]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2c392ee-6324-42cf-be09-2b833cecdce1 tempest-VolumesNegativeTest-175710782 None] Lock "cinder-376d9b7e-e006-4bad-a2a5-12f818f79fca-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Flow 'volume_create_manager' (bdd44914-fb80-4efb-b138-3fe83f18753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eccc628-3eb2-444b-94a1-585e393f5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eccc628-3eb2-444b-94a1-585e393f5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1108364261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c10a663-d417-45a6-8bd5-2460a8e39d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bd440a83074d47b128755695a71cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:00Z,use_quota=True,user_id='703b3238f8ae4530972373b6de87aab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e8990f5-ce91-4d22-9435-4c75a733e03a),volume_type_id=6e8990f5-ce91-4d22-9435-4c75a733e03a)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4067ca-ef45-426f-9a20-1b9f6f835d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:00 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4067ca-ef45-426f-9a20-1b9f6f835d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:00 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa7b737-b2e4-420d-bcab-1c002f10dcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa7b737-b2e4-420d-bcab-1c002f10dcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c10a663-d417-45a6-8bd5-2460a8e39d06', 'volume_name': 'volume-8c10a663-d417-45a6-8bd5-2460a8e39d06', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528cf48-cda4-4548-b6da-feda54e59d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528cf48-cda4-4548-b6da-feda54e59d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a6993-322e-4c22-9829-48f5e35779c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Volume 8c10a663-d417-45a6-8bd5-2460a8e39d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c10a663-d417-45a6-8bd5-2460a8e39d06', 'volume_size': 1} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1108364261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c10a663-d417-45a6-8bd5-2460a8e39d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bd440a83074d47b128755695a71cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:00Z,use_quota=True,user_id='703b3238f8ae4530972373b6de87aab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e8990f5-ce91-4d22-9435-4c75a733e03a),volume_type_id=6e8990f5-ce91-4d22-9435-4c75a733e03a)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Creating volume 8c10a663-d417-45a6-8bd5-2460a8e39d06 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:00 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:00 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 1073741824 Sep 02 16:28:00 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:00 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:00 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:00 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac" returned: 0 in 0.480s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:00 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac Sep 02 16:28:00 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:00 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Deleted volume successfully. Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f639983e-fabf-4926-babb-e3cbcf291d15 tempest-VolumesActionsTest-221896770 None] Lock "cinder-d688b509-fd6a-437e-bc10-ccfc002aa8f4-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:00 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 1073741824" returned: 0 in 0.487s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:00 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 Sep 02 16:28:00 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:00 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0e31c3ca-e0db-4af6-914e-8767b93448ac" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-0e31c3ca-e0db-4af6-914e-8767b93448ac" released by "delete_volume" :: held 0.815s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Created reservations ['381a0401-4925-4a59-89e4-b06ff8572f8d', 'f42cd8e3-e209-410f-9b98-7545df0479c0', 'fa069d5d-32b2-40c2-bcbb-cead425bfc41', '89113426-f9c2-4d0d-b21a-cfcc5119bd68'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:01 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:01 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:01 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06" returned: 0 in 0.331s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a6993-322e-4c22-9829-48f5e35779c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c10a663-d417-45a6-8bd5-2460a8e39d06', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9204e154-c417-4319-8bb0-dad45af8a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Volume volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 (8c10a663-d417-45a6-8bd5-2460a8e39d06): created successfully Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9204e154-c417-4319-8bb0-dad45af8a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Flow 'volume_create_manager' (bdd44914-fb80-4efb-b138-3fe83f18753a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c0e0507e-ef52-4378-9b9e-eadd6d151f3d tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Created volume successfully. Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-quobyte-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ae963c-b920-40c2-9dcf-7bc4dcddba7c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:01 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 Sep 02 16:28:01 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:01 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.544s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Deleted volume successfully. Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ca401ec2-c5d7-457e-800b-f93e362a2fb6 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-0e31c3ca-e0db-4af6-914e-8767b93448ac-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:01 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" returned: 0 in 0.525s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:01 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84 Sep 02 16:28:01 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:02 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" returned: 0 in 0.332s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84" released by "delete_volume" :: held 0.957s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Created reservations ['05eed250-1edb-479b-9895-0c4bea447cbd', '9b15c5c6-dec0-41ae-9939-116908aa9a0f', 'b0adbaa4-a623-4b6f-a3ab-21b51b84194a', 'bd1f3b15-41bc-44f5-b913-9ea0c6e801c6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:02 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:02 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-5a2890e2-ddd3-430a-a769-5b602f5811e3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-5a2890e2-ddd3-430a-a769-5b602f5811e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "cinder-quobyte-5a2890e2-ddd3-430a-a769-5b602f5811e3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-5a2890e2-ddd3-430a-a769-5b602f5811e3" acquired by "delete_volume" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:02 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5539e9-3661-4657-a3cd-207bf3c11b91]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.391s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Deleted volume successfully. Sep 02 16:28:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8436f427-c29a-4545-82fe-c57402a90720 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-23e8b515-2cdc-43e1-a9eb-97eac1d0ba84-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:03 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 Sep 02 16:28:03 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:03 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:03 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:03 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.338s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c56099ec-02f4-4096-97ce-6506e6d06f93 tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Retype volume completed successfully. Sep 02 16:28:03 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3" returned: 0 in 0.555s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:03 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3 Sep 02 16:28:03 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:03 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5a2890e2-ddd3-430a-a769-5b602f5811e3" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-quobyte-5a2890e2-ddd3-430a-a769-5b602f5811e3" released by "delete_volume" :: held 0.947s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Created reservations ['8a54a6fd-2861-47c6-971d-e79bfdef37cf', '34f7e793-1e1a-4689-9815-8dfba4aa31b1', 'c644fadc-dafe-42df-b4c1-5aeb19fb474f', 'f319e6fa-10c6-4122-828b-299d0f0e416f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:03 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:03 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "cinder-8c10a663-d417-45a6-8bd5-2460a8e39d06-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "cinder-8c10a663-d417-45a6-8bd5-2460a8e39d06-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "cinder-quobyte-8c10a663-d417-45a6-8bd5-2460a8e39d06" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:04 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.408s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "cinder-quobyte-8c10a663-d417-45a6-8bd5-2460a8e39d06" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Deleted volume successfully. Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a3cb2-9585-47af-81cf-bbe17548df88]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-586d4b21-65af-4f9b-bdcf-28288137ba21 tempest-CreateVolumesFromImageTest-470158869 None] Lock "cinder-5a2890e2-ddd3-430a-a769-5b602f5811e3-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:04 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 Sep 02 16:28:04 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:04 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06" returned: 0 in 0.469s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:04 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06 Sep 02 16:28:04 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (eebcff1d-aaf2-42d1-8457-bd04d3faf2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8b876a-b8de-463f-8b63-047ef7e671f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8b876a-b8de-463f-8b63-047ef7e671f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434627442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d04d1d6-738c-467e-aa99-114770db2d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:05Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dac09e8-20b0-4578-b5e7-c92892b2ec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dac09e8-20b0-4578-b5e7-c92892b2ec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be59dae1-c06a-408a-87db-b94e0e68ad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be59dae1-c06a-408a-87db-b94e0e68ad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d04d1d6-738c-467e-aa99-114770db2d95', 'volume_name': 'volume-2d04d1d6-738c-467e-aa99-114770db2d95', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6eb5bc4-862f-420c-aeb4-05f26732dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6eb5bc4-862f-420c-aeb4-05f26732dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6bbc76-2ca2-45fd-8915-dea5c0ef1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Volume 2d04d1d6-738c-467e-aa99-114770db2d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d04d1d6-738c-467e-aa99-114770db2d95', 'volume_size': 1} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434627442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d04d1d6-738c-467e-aa99-114770db2d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:05Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Creating volume 2d04d1d6-738c-467e-aa99-114770db2d95 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:04 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:05 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 1073741824 Sep 02 16:28:05 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:05 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c10a663-d417-45a6-8bd5-2460a8e39d06" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "cinder-quobyte-8c10a663-d417-45a6-8bd5-2460a8e39d06" released by "delete_volume" :: held 0.862s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:05 devstack cinder-volume[87051]: WARNING cinder.quota [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:28:05 devstack cinder-volume[87051]: WARNING cinder.quota [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Created reservations ['515f6a61-8a20-43cf-a3db-39da03767214', 'e09cf986-c542-4f97-aa6a-2b89a98955ff', '8fad5915-e131-490d-9721-6d679bf43141', 'e59fe22b-8025-429e-a400-d2b7b6408fff'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:05 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:05 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:05 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 1073741824" returned: 0 in 0.631s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:05 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 Sep 02 16:28:05 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:05 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.425s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Deleted volume successfully. Sep 02 16:28:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-453b4fae-d1e6-4fe9-ad64-1809a01d303c tempest-VolumeRetypeWithoutMigrationTest-1511719241 None] Lock "cinder-8c10a663-d417-45a6-8bd5-2460a8e39d06-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:06 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95" returned: 0 in 0.357s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6bbc76-2ca2-45fd-8915-dea5c0ef1582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d04d1d6-738c-467e-aa99-114770db2d95', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5b5b6-1b5f-4b2a-872a-65710e1ca566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Volume volume-2d04d1d6-738c-467e-aa99-114770db2d95 (2d04d1d6-738c-467e-aa99-114770db2d95): created successfully Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5b5b6-1b5f-4b2a-872a-65710e1ca566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (eebcff1d-aaf2-42d1-8457-bd04d3faf2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fbc5662c-64e0-4ee1-ba56-cd4eb75391b0 tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-2d04d1d6-738c-467e-aa99-114770db2d95-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-2d04d1d6-738c-467e-aa99-114770db2d95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-quobyte-2d04d1d6-738c-467e-aa99-114770db2d95" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-2d04d1d6-738c-467e-aa99-114770db2d95" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2c131-13ae-42cb-add6-d7b0354aef5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:07 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 Sep 02 16:28:07 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:07 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95" returned: 0 in 0.483s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:08 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95 Sep 02 16:28:08 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:08 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2d04d1d6-738c-467e-aa99-114770db2d95" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-2d04d1d6-738c-467e-aa99-114770db2d95" released by "delete_volume" :: held 0.881s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Created reservations ['dc8bfd1d-bdb1-4a7e-9f20-74f5f70fd85b', '52af642b-93a0-4b5c-a99c-5adf35147d2b', '08dc6f4d-f13e-41c9-9579-974cdc67d611', '2424e913-f2ae-4c9c-b75c-c48333963d19'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:08 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:08 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (98e19a7d-9fd5-4471-a98b-e2a2ce3b6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8977e24e-57b1-4a80-aa9d-e822b258d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8977e24e-57b1-4a80-aa9d-e822b258d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668206335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19baa70-d91e-48fe-9bba-b2d99e91af4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:08Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb65a5e-32d7-4b1f-8be4-3ba6e54b0eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb65a5e-32d7-4b1f-8be4-3ba6e54b0eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e74050f-6379-4f43-a8c7-f123eaeef7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e74050f-6379-4f43-a8c7-f123eaeef7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19baa70-d91e-48fe-9bba-b2d99e91af4a', 'volume_name': 'volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14667df5-a842-46b5-8a1b-acf55a9491aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14667df5-a842-46b5-8a1b-acf55a9491aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a10ef5-c66b-4a28-92bc-781e7aa8a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:08 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume c19baa70-d91e-48fe-9bba-b2d99e91af4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a', 'volume_size': 1} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668206335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19baa70-d91e-48fe-9bba-b2d99e91af4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:08Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume c19baa70-d91e-48fe-9bba-b2d99e91af4a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:08 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:08 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a 1073741824 Sep 02 16:28:08 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:08 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Deleted volume successfully. Sep 02 16:28:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f6ffa5f1-f07e-44ee-9baa-0303f5023592 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-2d04d1d6-738c-467e-aa99-114770db2d95-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (6fe5a446-7247-4067-851c-385d49736579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caccd36-b38b-457f-982d-d9d044d6d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a 1073741824" returned: 0 in 0.639s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caccd36-b38b-457f-982d-d9d044d6d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767987035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8129517a-c35d-4671-bacd-f3883f79021b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:09Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb0af50-7b97-4aea-afd6-5239e6b53b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb0af50-7b97-4aea-afd6-5239e6b53b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ee9fa7-1852-4483-a155-59fccb23460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ee9fa7-1852-4483-a155-59fccb23460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8129517a-c35d-4671-bacd-f3883f79021b', 'volume_name': 'volume-8129517a-c35d-4671-bacd-f3883f79021b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe4e7a4-3385-473d-be6f-d072234e87de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe4e7a4-3385-473d-be6f-d072234e87de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fe4eb5-4ec9-485c-b4b4-0a15a0b14f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Volume 8129517a-c35d-4671-bacd-f3883f79021b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8129517a-c35d-4671-bacd-f3883f79021b', 'volume_size': 1} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:09 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a Sep 02 16:28:09 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:09 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767987035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8129517a-c35d-4671-bacd-f3883f79021b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:09Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Creating volume 8129517a-c35d-4671-bacd-f3883f79021b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:09 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a10ef5-c66b-4a28-92bc-781e7aa8a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96281592-9523-4086-9a20-c42137c87c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:09 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b 1073741824 Sep 02 16:28:09 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:09 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a (c19baa70-d91e-48fe-9bba-b2d99e91af4a): created successfully Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96281592-9523-4086-9a20-c42137c87c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (98e19a7d-9fd5-4471-a98b-e2a2ce3b6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae434740-7707-4829-8539-fd5a778c08da tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:10 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b 1073741824" returned: 0 in 0.604s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:10 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b Sep 02 16:28:10 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:10 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b" returned: 0 in 0.312s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fe4eb5-4ec9-485c-b4b4-0a15a0b14f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8129517a-c35d-4671-bacd-f3883f79021b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e03af5-e03c-49b5-a520-fb778bf5310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:10 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Volume volume-8129517a-c35d-4671-bacd-f3883f79021b (8129517a-c35d-4671-bacd-f3883f79021b): created successfully Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e03af5-e03c-49b5-a520-fb778bf5310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (6fe5a446-7247-4067-851c-385d49736579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:10 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6d505097-5db5-47cb-b395-fff1c656956c tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (5969cdd0-fcd4-4db5-8d23-45cf5e3d852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9cfecd-229b-4f18-95d0-1d3e0c42edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9cfecd-229b-4f18-95d0-1d3e0c42edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843596146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b8a998-f61d-411a-80d6-ed1b4152616f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:11Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44147402-07f7-4725-8122-58baed2ed0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44147402-07f7-4725-8122-58baed2ed0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2f0d09-bd4c-4ed9-a2ba-db73d2a28250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2f0d09-bd4c-4ed9-a2ba-db73d2a28250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b8a998-f61d-411a-80d6-ed1b4152616f', 'volume_name': 'volume-b7b8a998-f61d-411a-80d6-ed1b4152616f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42e9dda-07e2-4ff4-8a4a-9ab28a826b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42e9dda-07e2-4ff4-8a4a-9ab28a826b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500b81a8-7e56-4ccf-bb86-e657118afa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume b7b8a998-f61d-411a-80d6-ed1b4152616f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b8a998-f61d-411a-80d6-ed1b4152616f', 'volume_size': 1} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843596146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b8a998-f61d-411a-80d6-ed1b4152616f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:11Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume b7b8a998-f61d-411a-80d6-ed1b4152616f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:11 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:11 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f 1073741824 Sep 02 16:28:11 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (13b4207c-e475-4f93-9f3b-9cca5e20d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d3b85-1a7b-44d5-a1bc-860f779c3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d3b85-1a7b-44d5-a1bc-860f779c3e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730793718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdfe0a8-ff30-4f76-b0b1-902b804b31fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:12Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbac8c-c36b-4f6a-b96f-2162a2bcbe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbac8c-c36b-4f6a-b96f-2162a2bcbe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1833a4-1d03-4d67-b6a1-859a0073add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1833a4-1d03-4d67-b6a1-859a0073add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fdfe0a8-ff30-4f76-b0b1-902b804b31fb', 'volume_name': 'volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471dda7-7301-43e1-920d-e6d5dec8efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471dda7-7301-43e1-920d-e6d5dec8efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2288a3ff-506f-4b98-9c0f-ef260902c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume 6fdfe0a8-ff30-4f76-b0b1-902b804b31fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb', 'volume_size': 1} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:12 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-8129517a-c35d-4671-bacd-f3883f79021b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f 1073741824" returned: 0 in 0.812s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "cinder-8129517a-c35d-4671-bacd-f3883f79021b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-quobyte-8129517a-c35d-4671-bacd-f3883f79021b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-8129517a-c35d-4671-bacd-f3883f79021b" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:12 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f Sep 02 16:28:12 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d595f41-6c34-4ad5-9ca1-bd0eeb32beb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:12 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b Sep 02 16:28:12 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (f81e32f0-03ee-4e13-ac08-b2dc687a3425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33682b73-666c-4716-835c-b44e4580c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33682b73-666c-4716-835c-b44e4580c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1103479861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafe3843-5627-443d-aebe-5dab8de9df5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:13Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94629d02-9ca1-4fa5-9682-1ed3d8995835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94629d02-9ca1-4fa5-9682-1ed3d8995835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab28545-690a-4bb1-9c25-aa93623dc30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab28545-690a-4bb1-9c25-aa93623dc30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cafe3843-5627-443d-aebe-5dab8de9df5d', 'volume_name': 'volume-cafe3843-5627-443d-aebe-5dab8de9df5d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a3fb1d-7b4b-4a1b-b1b6-1b9a60ee8ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a3fb1d-7b4b-4a1b-b1b6-1b9a60ee8ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c169a5b-ca5f-44f1-b5d7-1d8f8e14bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume cafe3843-5627-443d-aebe-5dab8de9df5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cafe3843-5627-443d-aebe-5dab8de9df5d', 'volume_size': 1} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f" returned: 0 in 0.545s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730793718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdfe0a8-ff30-4f76-b0b1-902b804b31fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:12Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume 6fdfe0a8-ff30-4f76-b0b1-902b804b31fb {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:12 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:12 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb 1073741824 Sep 02 16:28:12 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500b81a8-7e56-4ccf-bb86-e657118afa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b8a998-f61d-411a-80d6-ed1b4152616f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75ac314-48a0-4a4d-86a4-bb5be5507aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-b7b8a998-f61d-411a-80d6-ed1b4152616f (b7b8a998-f61d-411a-80d6-ed1b4152616f): created successfully Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75ac314-48a0-4a4d-86a4-bb5be5507aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (5969cdd0-fcd4-4db5-8d23-45cf5e3d852a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:12 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b" returned: 0 in 0.582s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a3dd56cb-7859-4372-a5e7-d2004f79e00d tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:12 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b Sep 02 16:28:12 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:13 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8129517a-c35d-4671-bacd-f3883f79021b" returned: 0 in 0.484s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (eedca6b8-8352-468f-bb73-2c9229b099c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50089c06-eee1-40a2-9c66-23343e9d6577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-8129517a-c35d-4671-bacd-f3883f79021b" released by "delete_volume" :: held 1.221s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50089c06-eee1-40a2-9c66-23343e9d6577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069730096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1b74a-73b6-44c3-af64-dc1deee1e96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:13Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97a132f-6144-4b0d-b79d-aa23fb85c44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97a132f-6144-4b0d-b79d-aa23fb85c44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1786cd-8181-47da-a092-d36c3c2a9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1786cd-8181-47da-a092-d36c3c2a9996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c1b74a-73b6-44c3-af64-dc1deee1e96c', 'volume_name': 'volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a7ee23-5f00-43e6-93b8-ed48f722478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a7ee23-5f00-43e6-93b8-ed48f722478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefb733d-58d8-4075-8fbf-ab9877228f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume 30c1b74a-73b6-44c3-af64-dc1deee1e96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c', 'volume_size': 1} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Created reservations ['944bd65f-d9ac-4d8d-a322-39cc329916a2', '35c0bf3a-0edb-4ff0-a757-f9a20d7262c6', 'af373461-39d4-4c3b-ae09-242fbd10ba17', '70cd15ad-57f6-45b3-bef6-07618abceea1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:13 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb 1073741824" returned: 0 in 0.967s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (9627cf9a-089e-4b40-b3b2-9631b709bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6396657-4225-47e0-9f1c-8ccb195be41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:13 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb Sep 02 16:28:13 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6396657-4225-47e0-9f1c-8ccb195be41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184155127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ffac8b-c120-4bc3-b2e2-7253e4b74d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:14Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d0a24-3918-42de-a114-d43a801aba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d0a24-3918-42de-a114-d43a801aba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6307f9-35aa-40c4-87df-fac6bb68aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6307f9-35aa-40c4-87df-fac6bb68aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ffac8b-c120-4bc3-b2e2-7253e4b74d71', 'volume_name': 'volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677d504-1432-492c-a765-e01965fa5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677d504-1432-492c-a765-e01965fa5f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a685a7ff-0e45-4e55-a041-a18403bb8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume 20ffac8b-c120-4bc3-b2e2-7253e4b74d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71', 'volume_size': 1} Sep 02 16:28:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:14 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:14 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:14 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" returned: 0 in 0.357s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1103479861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafe3843-5627-443d-aebe-5dab8de9df5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:13Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume cafe3843-5627-443d-aebe-5dab8de9df5d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:14 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2288a3ff-506f-4b98-9c0f-ef260902c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:14 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d 1073741824 Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26b66f-07af-4bfa-b903-b35514f3813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:14 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb (6fdfe0a8-ff30-4f76-b0b1-902b804b31fb): created successfully Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26b66f-07af-4bfa-b903-b35514f3813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (13b4207c-e475-4f93-9f3b-9cca5e20d81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0650025e-13d1-4bd9-a3f6-3681d1e2190a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:14 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.469s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Deleted volume successfully. Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ddeaa7b-5f82-40d4-9db1-337345d8045e tempest-VolumesActionsTest-1748217683 None] Lock "cinder-8129517a-c35d-4671-bacd-f3883f79021b-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:14 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d 1073741824" returned: 0 in 0.702s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:15 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d Sep 02 16:28:15 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (40375337-99c7-4bb1-ab5d-22fce92d61c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa92fe2-f3af-430c-956e-dada436ffbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa92fe2-f3af-430c-956e-dada436ffbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430546459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6075b-cf6c-4b39-afcc-2a1e0b8736f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:15Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3442736f-019b-4b68-bfcb-16798f0319bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3442736f-019b-4b68-bfcb-16798f0319bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4d4fe-60f5-4dc2-8614-348392fe0b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4d4fe-60f5-4dc2-8614-348392fe0b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad6075b-cf6c-4b39-afcc-2a1e0b8736f9', 'volume_name': 'volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493dc0a4-9f92-429c-9512-9c76b08977e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493dc0a4-9f92-429c-9512-9c76b08977e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b154ea92-3b28-4d7f-9401-cacfee9fa137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Volume dad6075b-cf6c-4b39-afcc-2a1e0b8736f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9', 'volume_size': 1} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d" returned: 0 in 0.473s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069730096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1b74a-73b6-44c3-af64-dc1deee1e96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:13Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume 30c1b74a-73b6-44c3-af64-dc1deee1e96c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:15 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:15 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c 1073741824 Sep 02 16:28:15 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c169a5b-ca5f-44f1-b5d7-1d8f8e14bdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cafe3843-5627-443d-aebe-5dab8de9df5d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c5b95-721e-40f8-b7f4-73a1025450f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-cafe3843-5627-443d-aebe-5dab8de9df5d (cafe3843-5627-443d-aebe-5dab8de9df5d): created successfully Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c5b95-721e-40f8-b7f4-73a1025450f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (f81e32f0-03ee-4e13-ac08-b2dc687a3425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-10b2bc23-f603-44f5-8ab8-00f2cf0112e6 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:16 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c 1073741824" returned: 0 in 0.654s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:16 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c Sep 02 16:28:16 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:16 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184155127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ffac8b-c120-4bc3-b2e2-7253e4b74d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd8bb316d45406d8a6c01e6456bf199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:14Z,use_quota=True,user_id='cc82288e81a641b7ae59ee12f4fe7629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Creating volume 20ffac8b-c120-4bc3-b2e2-7253e4b74d71 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:16 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 1073741824 Sep 02 16:28:16 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefb733d-58d8-4075-8fbf-ab9877228f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352b0139-9672-4c13-a0fe-46b9533d6373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c (30c1b74a-73b6-44c3-af64-dc1deee1e96c): created successfully Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352b0139-9672-4c13-a0fe-46b9533d6373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (eedca6b8-8352-468f-bb73-2c9229b099c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a749db2c-a48d-4bb4-aa02-6c5e1d48b5f1 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:17 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 1073741824" returned: 0 in 0.532s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:17 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 Sep 02 16:28:17 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:17 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430546459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6075b-cf6c-4b39-afcc-2a1e0b8736f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:15Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Creating volume dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a685a7ff-0e45-4e55-a041-a18403bb8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc73d64-2fc6-4135-b4b3-dbe798afa90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:17 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 1073741824 Sep 02 16:28:17 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Volume volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 (20ffac8b-c120-4bc3-b2e2-7253e4b74d71): created successfully Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc73d64-2fc6-4135-b4b3-dbe798afa90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Flow 'volume_create_manager' (9627cf9a-089e-4b40-b3b2-9631b709bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-66c08461-c05c-46e5-a491-86b056a0f90a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created volume successfully. Sep 02 16:28:17 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 1073741824" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:18 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 Sep 02 16:28:18 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:18 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" returned: 0 in 0.357s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b154ea92-3b28-4d7f-9401-cacfee9fa137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28ba6d4-7e38-4814-a485-ef067e013ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Volume volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 (dad6075b-cf6c-4b39-afcc-2a1e0b8736f9): created successfully Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28ba6d4-7e38-4814-a485-ef067e013ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (40375337-99c7-4bb1-ab5d-22fce92d61c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1f9e4c8c-0af6-47d2-90c0-b6638b817b1d tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-20ffac8b-c120-4bc3-b2e2-7253e4b74d71-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-20ffac8b-c120-4bc3-b2e2-7253e4b74d71-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee89a3-fff1-4798-96ce-00a911e3816f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:18 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 Sep 02 16:28:18 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:18 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" returned: 0 in 0.399s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:19 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71 Sep 02 16:28:19 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:19 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" returned: 0 in 0.334s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-20ffac8b-c120-4bc3-b2e2-7253e4b74d71" released by "delete_volume" :: held 0.782s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['604494d6-715c-458b-ab75-7c71f769f96d', 'a1ab01f7-c9b6-40af-a4b0-eb525dbd60aa', '21385f94-c18f-4ecd-b5b7-d591a1db85d5', '61901bea-93ce-41ba-8e49-60f8370e3c45'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:19 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:19 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-30c1b74a-73b6-44c3-af64-dc1deee1e96c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-30c1b74a-73b6-44c3-af64-dc1deee1e96c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-30c1b74a-73b6-44c3-af64-dc1deee1e96c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-30c1b74a-73b6-44c3-af64-dc1deee1e96c" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93eada1-ea25-40a8-a458-1961128c0834]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:19 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a04f9003-83e7-4aae-a066-4bbb16f21b65 tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-20ffac8b-c120-4bc3-b2e2-7253e4b74d71-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-quobyte-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e28c7-24c8-41e6-a4f5-6841c203d925]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:20 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c Sep 02 16:28:20 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:20 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 Sep 02 16:28:20 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:20 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c" returned: 0 in 0.499s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:20 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c Sep 02 16:28:20 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:20 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:20 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9 Sep 02 16:28:20 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:20 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30c1b74a-73b6-44c3-af64-dc1deee1e96c" returned: 0 in 0.296s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-30c1b74a-73b6-44c3-af64-dc1deee1e96c" released by "delete_volume" :: held 0.872s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['1d7e803f-fc9b-41e0-a45b-c1c8a20ba808', '346a3b4f-da49-47c0-b299-8152becc17e5', 'cfc25ca2-aff8-43fd-8334-35e93a8dcfff', '8ece5679-7292-4a4d-b4f7-7dd96a480097'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:20 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9" released by "delete_volume" :: held 0.885s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Created reservations ['0687c49b-0d13-4394-a8dc-fd307e8a77be', '2fc7b9c5-28ee-44e2-9843-7e2b6f3509bc', 'ab824960-a2ff-4a1c-b2c1-eac84e8f19a7', 'df28a262-0bff-4703-81c2-f561f55a5a90'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:21 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:21 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-cafe3843-5627-443d-aebe-5dab8de9df5d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-cafe3843-5627-443d-aebe-5dab8de9df5d-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:21 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:21 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-cafe3843-5627-443d-aebe-5dab8de9df5d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-cafe3843-5627-443d-aebe-5dab8de9df5d" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25ff5e-dca1-4f7d-abf7-8753fe9f8812]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:21 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-302b47c9-c32d-40a9-afed-f71146fb18ab tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-30c1b74a-73b6-44c3-af64-dc1deee1e96c-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:21 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.375s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:21 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d Sep 02 16:28:21 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Deleted volume successfully. Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-73c321a7-7a05-41de-8494-1055b1b237e6 tempest-VolumesActionsTest-1748217683 None] Lock "cinder-dad6075b-cf6c-4b39-afcc-2a1e0b8736f9-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:21 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d" returned: 0 in 0.461s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:21 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d Sep 02 16:28:21 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:22 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cafe3843-5627-443d-aebe-5dab8de9df5d" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-cafe3843-5627-443d-aebe-5dab8de9df5d" released by "delete_volume" :: held 0.779s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['daad7390-4751-4039-95ec-0c736189d4b5', '6be7edcc-51d1-4d4f-bdf3-47dbd7bc1fd5', '43d8f1df-2e2e-4a78-bd7c-5acdb71b0a11', '10885874-f1f7-4fca-b3e5-55bce151772c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:22 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:22 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcbc0f-16d6-452a-bc24-ae8e25353c74]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:22 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.489s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c2198d2c-d2e7-4767-a197-771c8a9db6be tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-cafe3843-5627-443d-aebe-5dab8de9df5d-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:22 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb Sep 02 16:28:22 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (b8fcb445-b302-4523-a7c9-ee71a1dc1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:23 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf7516-ec2c-4de5-9bec-154f3bb2b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" returned: 0 in 0.598s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf7516-ec2c-4de5-9bec-154f3bb2b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725383957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b369d4a-f375-41b5-9589-fe7b4c0e5686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:23Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:23 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb Sep 02 16:28:23 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5758567b-d52b-46ba-a88d-e46956145c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5758567b-d52b-46ba-a88d-e46956145c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56fca9a-b287-46de-9ea0-783cb119ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56fca9a-b287-46de-9ea0-783cb119ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b369d4a-f375-41b5-9589-fe7b4c0e5686', 'volume_name': 'volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25f5ff8-9afe-43b7-b313-4f924853e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25f5ff8-9afe-43b7-b313-4f924853e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f5a228-8fb6-4af1-a05a-d0d4fa6f71bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Volume 5b369d4a-f375-41b5-9589-fe7b4c0e5686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686', 'volume_size': 1} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725383957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b369d4a-f375-41b5-9589-fe7b4c0e5686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:23Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Creating volume 5b369d4a-f375-41b5-9589-fe7b4c0e5686 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:23 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:23 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 1073741824 Sep 02 16:28:23 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:23 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb" released by "delete_volume" :: held 0.962s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['ad7a94eb-40a4-468b-981f-7ac88bc20feb', 'd11f345f-ca82-44b7-b5ed-d5ae01599310', '15a54313-fde9-40b2-9c9f-d988b1ecfbf9', 'cfa5805f-af45-4ac4-908f-eca23b477a18'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:23 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:23 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-b7b8a998-f61d-411a-80d6-ed1b4152616f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-b7b8a998-f61d-411a-80d6-ed1b4152616f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-b7b8a998-f61d-411a-80d6-ed1b4152616f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-b7b8a998-f61d-411a-80d6-ed1b4152616f" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10286b6-5a32-498d-bd66-3ab2527ae898]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:24 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f Sep 02 16:28:24 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:24 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 1073741824" returned: 0 in 0.844s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:24 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.472s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b232255c-5967-4e4b-a24b-8a1ed1dbdc8f tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-6fdfe0a8-ff30-4f76-b0b1-902b804b31fb-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:24 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 Sep 02 16:28:24 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:24 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f" returned: 0 in 0.561s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:24 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f Sep 02 16:28:24 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:24 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f5a228-8fb6-4af1-a05a-d0d4fa6f71bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d95ae3f-b228-449a-9cec-15e3859ff59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:24 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Volume volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 (5b369d4a-f375-41b5-9589-fe7b4c0e5686): created successfully Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d95ae3f-b228-449a-9cec-15e3859ff59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (b8fcb445-b302-4523-a7c9-ee71a1dc1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8313ad41-d704-425b-89d1-ce927e7ab700 tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:28:24 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b7b8a998-f61d-411a-80d6-ed1b4152616f" returned: 0 in 0.374s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-b7b8a998-f61d-411a-80d6-ed1b4152616f" released by "delete_volume" :: held 0.996s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['2ef27970-b6c6-4487-a474-29967fe6d774', '6b7cccc1-ec79-444b-b10d-a6b5050dee9e', 'd4c9b9fb-04c1-460e-9ebf-b2aac3e44ab5', '715428c1-9d59-46d5-9548-6c2e2a149ae6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:25 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:25 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-c19baa70-d91e-48fe-9bba-b2d99e91af4a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-c19baa70-d91e-48fe-9bba-b2d99e91af4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "cinder-quobyte-c19baa70-d91e-48fe-9bba-b2d99e91af4a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-c19baa70-d91e-48fe-9bba-b2d99e91af4a" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3d2cc-b13c-46cf-9fd0-66074889ed10]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:25 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a Sep 02 16:28:25 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:25 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.494s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-5b369d4a-f375-41b5-9589-fe7b4c0e5686-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "cinder-5b369d4a-f375-41b5-9589-fe7b4c0e5686-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-610aeb01-cc4d-48ea-bbd6-d76257c3f65a tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-b7b8a998-f61d-411a-80d6-ed1b4152616f-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Acquiring lock "cinder-quobyte-5b369d4a-f375-41b5-9589-fe7b4c0e5686" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-5b369d4a-f375-41b5-9589-fe7b4c0e5686" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f003c206-c2df-4b42-b520-4e39d6740c0e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:25 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a" returned: 0 in 0.522s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:25 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a Sep 02 16:28:25 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:25 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 Sep 02 16:28:25 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:26 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c19baa70-d91e-48fe-9bba-b2d99e91af4a" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-quobyte-c19baa70-d91e-48fe-9bba-b2d99e91af4a" released by "delete_volume" :: held 0.906s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Created reservations ['89cee377-18a9-442c-b4b4-2bbe38519c6e', 'e9c155c2-bc3a-4674-85f0-13fc420b70fb', '619dcb31-59c1-467e-af96-4539e1c23706', '001462e2-882b-464d-bc32-a96a0c46128c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:26 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686" returned: 0 in 0.527s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:26 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686 Sep 02 16:28:26 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:26 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:26 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:26 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5b369d4a-f375-41b5-9589-fe7b4c0e5686" returned: 0 in 0.475s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "cinder-quobyte-5b369d4a-f375-41b5-9589-fe7b4c0e5686" released by "delete_volume" :: held 1.058s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:26 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.445s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:26 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Deleted volume successfully. Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b8d0fb98-00f1-450c-b93c-7978647cfdfa tempest-CreateVolumesFromSourceVolumeTest-2110529527 None] Lock "cinder-c19baa70-d91e-48fe-9bba-b2d99e91af4a-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Created reservations ['579eef35-e099-4f5d-94d8-21fb7cc864ad', '7c87cbe9-da01-4789-896f-025bbf493e3e', 'f6f1de1f-b070-4fe1-8b72-77c04a9eb9fd', '50a2b230-3a6f-4a03-aa01-e543c788e574'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:27 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:27 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:27 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.351s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Deleted volume successfully. Sep 02 16:28:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09074c47-9364-4941-88b5-cc7de196ccde tempest-VolumesActionsTest-1748217683 None] Lock "cinder-5b369d4a-f375-41b5-9589-fe7b4c0e5686-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (02851618-951f-4591-8ad6-ea8d50dffc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fbe57-563e-4049-be60-4aa87fe913e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fbe57-563e-4049-be60-4aa87fe913e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-437291439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b761d3bf-adb1-4013-81b6-eaf15e757903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:29Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea92bc43-a467-458b-b192-7a869dd7fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea92bc43-a467-458b-b192-7a869dd7fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfbf7a2-c361-4143-9be7-98998f769cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfbf7a2-c361-4143-9be7-98998f769cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b761d3bf-adb1-4013-81b6-eaf15e757903', 'volume_name': 'volume-b761d3bf-adb1-4013-81b6-eaf15e757903', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f67a9f-2412-4416-ac11-aec29c82a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f67a9f-2412-4416-ac11-aec29c82a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe6122-d554-4574-8991-178f17141bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:28 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Volume b761d3bf-adb1-4013-81b6-eaf15e757903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b761d3bf-adb1-4013-81b6-eaf15e757903', 'volume_size': 1} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-437291439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b761d3bf-adb1-4013-81b6-eaf15e757903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adddbf1ec5ad4653afd8ee668c764c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:29Z,use_quota=True,user_id='f40feab4e228405bb57246fb12a17ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Creating volume b761d3bf-adb1-4013-81b6-eaf15e757903 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:28 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:28 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 1073741824 Sep 02 16:28:28 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:29 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 1073741824" returned: 0 in 0.645s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:29 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 Sep 02 16:28:29 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:29 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe6122-d554-4574-8991-178f17141bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b761d3bf-adb1-4013-81b6-eaf15e757903', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4959dcf-6947-4849-8cbe-e34fd0b93699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:29 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Volume volume-b761d3bf-adb1-4013-81b6-eaf15e757903 (b761d3bf-adb1-4013-81b6-eaf15e757903): created successfully Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4959dcf-6947-4849-8cbe-e34fd0b93699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Flow 'volume_create_manager' (02851618-951f-4591-8ad6-ea8d50dffc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-43cf6146-8944-46ce-bbd7-e952f44a0b73 tempest-VolumesActionsTest-221896770 None] Created volume successfully. Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Flow 'volume_create_manager' (b95029d7-aaf7-402a-b4ac-84d3bfd93c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716828fc-0d82-42b3-add1-53462dd677ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716828fc-0d82-42b3-add1-53462dd677ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf95861-3c3d-4a4a-8307-e1286c1002a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6a61e51a6a42babc9934f30096e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:31Z,use_quota=True,user_id='71cfa4b6cd6e4a3db221ec0809b39d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20e34-cd68-440c-9d98-559032fab84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20e34-cd68-440c-9d98-559032fab84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d96668-02ca-4688-80c5-fe9283948f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d96668-02ca-4688-80c5-fe9283948f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf95861-3c3d-4a4a-8307-e1286c1002a1', 'volume_name': 'volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac49353-d680-46ab-a00a-8be43f2a77c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac49353-d680-46ab-a00a-8be43f2a77c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57f3d8c-4c2e-46cf-93b7-8f8261fdc959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Volume 5bf95861-3c3d-4a4a-8307-e1286c1002a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1', 'volume_size': 1} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf95861-3c3d-4a4a-8307-e1286c1002a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6a61e51a6a42babc9934f30096e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:31Z,use_quota=True,user_id='71cfa4b6cd6e4a3db221ec0809b39d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Creating volume 5bf95861-3c3d-4a4a-8307-e1286c1002a1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:31 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:31 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 1073741824 Sep 02 16:28:31 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-b761d3bf-adb1-4013-81b6-eaf15e757903-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "cinder-b761d3bf-adb1-4013-81b6-eaf15e757903-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Acquiring lock "cinder-quobyte-b761d3bf-adb1-4013-81b6-eaf15e757903" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "cinder-quobyte-b761d3bf-adb1-4013-81b6-eaf15e757903" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb844e83-cc2d-4fef-b097-1e091f512b30]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:31 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 Sep 02 16:28:31 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:31 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 1073741824" returned: 0 in 0.662s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:31 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 Sep 02 16:28:31 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:32 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903" returned: 0 in 0.469s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:32 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903 Sep 02 16:28:32 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:32 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1" returned: 0 in 0.331s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57f3d8c-4c2e-46cf-93b7-8f8261fdc959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0718b7-d284-41d8-8b25-2a842e1cbdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:32 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Volume volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 (5bf95861-3c3d-4a4a-8307-e1286c1002a1): created successfully Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0718b7-d284-41d8-8b25-2a842e1cbdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Flow 'volume_create_manager' (b95029d7-aaf7-402a-b4ac-84d3bfd93c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e9aeb1f2-8bac-4e61-8c9c-565676125cea tempest-CinderUnicodeTest-838024792 None] Created volume successfully. Sep 02 16:28:32 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b761d3bf-adb1-4013-81b6-eaf15e757903" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "cinder-quobyte-b761d3bf-adb1-4013-81b6-eaf15e757903" released by "delete_volume" :: held 0.842s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Created reservations ['5beb11fc-445f-4d26-9823-34efdfc6c189', 'ee27010f-d94f-4f87-8770-ce444496309d', '63de9e54-5fa3-4477-887a-429c26b1077e', '0cfa1ad3-d6b3-4019-a2ba-f8693bea4fc2'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:32 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:32 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:32 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Deleted volume successfully. Sep 02 16:28:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bd4d4940-ebc4-42e2-be27-77a9573b8d6e tempest-VolumesActionsTest-221896770 None] Lock "cinder-b761d3bf-adb1-4013-81b6-eaf15e757903-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Flow 'volume_create_manager' (4d095b1b-7fef-4376-920a-aaebff7ef8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a62843-a2f2-4a2c-a9e8-0f91d46001d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a62843-a2f2-4a2c-a9e8-0f91d46001d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518027928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba5e8c5-b2eb-4be6-9e71-52952cc3455e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6a61e51a6a42babc9934f30096e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:34Z,use_quota=True,user_id='71cfa4b6cd6e4a3db221ec0809b39d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da541458-8280-4f6e-b8e0-174d9ba6c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da541458-8280-4f6e-b8e0-174d9ba6c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89d68bb-866d-41d6-b6e6-cb57ad1bbdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89d68bb-866d-41d6-b6e6-cb57ad1bbdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba5e8c5-b2eb-4be6-9e71-52952cc3455e', 'volume_name': 'volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e23018d-63df-4c0a-9ea3-4dc4d2589262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e23018d-63df-4c0a-9ea3-4dc4d2589262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0889be-f29e-4048-8977-9658c610e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Volume fba5e8c5-b2eb-4be6-9e71-52952cc3455e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e', 'volume_size': 1} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518027928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba5e8c5-b2eb-4be6-9e71-52952cc3455e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6a61e51a6a42babc9934f30096e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:34Z,use_quota=True,user_id='71cfa4b6cd6e4a3db221ec0809b39d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Creating volume fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:34 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:34 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e 1073741824 Sep 02 16:28:34 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Flow 'volume_create_manager' (0bd376e1-5f79-488b-aa30-81602e4b38c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66ce6bc-dd04-4e9a-ad70-b07d6de483d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66ce6bc-dd04-4e9a-ad70-b07d6de483d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1679045991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba638a59-051d-48ef-b920-08c90de33b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602df055c3dd48ba988ccd1abe4a30b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:34Z,use_quota=True,user_id='54cafb03f3f74256bf84a427bfdb5de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa3a134-d4bb-435b-ade2-8e07703fcb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa3a134-d4bb-435b-ade2-8e07703fcb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99643648-c254-479d-9503-c77f423bf9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99643648-c254-479d-9503-c77f423bf9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba638a59-051d-48ef-b920-08c90de33b5e', 'volume_name': 'volume-ba638a59-051d-48ef-b920-08c90de33b5e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea3b656-d47b-403b-8592-b620788a9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea3b656-d47b-403b-8592-b620788a9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade56e99-1e2b-4e11-aea7-0a0fbb6516e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Volume ba638a59-051d-48ef-b920-08c90de33b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba638a59-051d-48ef-b920-08c90de33b5e', 'volume_size': 1} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:34 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e 1073741824" returned: 0 in 0.698s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:34 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e Sep 02 16:28:35 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:35 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1679045991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba638a59-051d-48ef-b920-08c90de33b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602df055c3dd48ba988ccd1abe4a30b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:34Z,use_quota=True,user_id='54cafb03f3f74256bf84a427bfdb5de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Creating volume ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:35 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0889be-f29e-4048-8977-9658c610e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:35 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e 1073741824 Sep 02 16:28:35 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05218f2-803c-43f5-bfec-26a2d9a13dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:35 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Volume volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e (fba5e8c5-b2eb-4be6-9e71-52952cc3455e): created successfully Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05218f2-803c-43f5-bfec-26a2d9a13dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Flow 'volume_create_manager' (4d095b1b-7fef-4376-920a-aaebff7ef8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f65487cc-95d5-4859-8d3e-c61c6bc5681a tempest-CinderUnicodeTest-838024792 None] Created volume successfully. Sep 02 16:28:36 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e 1073741824" returned: 0 in 0.771s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:36 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e Sep 02 16:28:36 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:36 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.142s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade56e99-1e2b-4e11-aea7-0a0fbb6516e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba638a59-051d-48ef-b920-08c90de33b5e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f202dcf2-c1a4-4e0e-94fd-4cc9d1123fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Creating offline snapshot 9088530b-b48d-40de-bfc4-cdf6067d366b of volume fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:28:36 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Volume volume-ba638a59-051d-48ef-b920-08c90de33b5e (ba638a59-051d-48ef-b920-08c90de33b5e): created successfully Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f202dcf2-c1a4-4e0e-94fd-4cc9d1123fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Flow 'volume_create_manager' (0bd376e1-5f79-488b-aa30-81602e4b38c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e0a18-2134-4e19-bc97-ec737f7c3c00]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3d6e240d-b6c7-4ccb-aa1e-98aeeb705de2 tempest-SnapshotMetadataTestJSON-67382188 None] Created volume successfully. Sep 02 16:28:36 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e Sep 02 16:28:36 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:37 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" returned: 0 in 0.443s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:37 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b 1G Sep 02 16:28:37 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:37 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b 1G" returned: 0 in 0.502s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:37 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b Sep 02 16:28:37 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=158,cinder:UPDATE=256,cinder:DELETE=18,cinder:INSERT=49 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=163,cinder:UPDATE=215,cinder:INSERT=55,cinder:DELETE=24 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:28:38 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b" returned: 0 in 0.660s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:38 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b is being set with open permissions: ugo+rw Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:38 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b Sep 02 16:28:38 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:38 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b" returned: 0 in 0.502s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:38 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info Sep 02 16:28:38 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:39 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info" returned: 0 in 0.552s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:39 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info is being set with open permissions: ugo+rw Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:39 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info Sep 02 16:28:39 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:39 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.info" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.499s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Creating offline snapshot fac46218-2645-42a0-b5f0-0a90b9b6aa6c of volume ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:28:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-47446981-244b-40fa-93eb-9f5b1968d9b0 tempest-CinderUnicodeTest-838024792 None] Create snapshot completed successfully Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d6c08-9784-4eca-944a-c181db6a5345]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:39 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e Sep 02 16:28:39 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:40 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e" returned: 0 in 0.630s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:40 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c 1G Sep 02 16:28:40 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-9088530b-b48d-40de-bfc4-cdf6067d366b-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-9088530b-b48d-40de-bfc4-cdf6067d366b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-quobyte-9088530b-b48d-40de-bfc4-cdf6067d366b" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-9088530b-b48d-40de-bfc4-cdf6067d366b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Deleting offline snapshot 9088530b-b48d-40de-bfc4-cdf6067d366b of volume fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] snapshot_file for this snap is: volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c87e6bc-c827-4a7e-a33c-473166f35ba9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:41 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b Sep 02 16:28:41 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:41 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c 1G" returned: 0 in 0.712s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba638a59-051d-48ef-b920-08c90de33b5e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:41 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba638a59-051d-48ef-b920-08c90de33b5e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c Sep 02 16:28:41 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:41 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b" returned: 0 in 0.559s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:28:41 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba638a59-051d-48ef-b920-08c90de33b5e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c" returned: 0 in 0.431s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:41 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c is being set with open permissions: ugo+rw Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b4818-b93a-40e2-93eb-d44ddc61067b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:41 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c Sep 02 16:28:41 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:41 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e Sep 02 16:28:41 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:41 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c" returned: 0 in 0.428s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:42 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info Sep 02 16:28:42 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:42 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" returned: 0 in 0.539s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:42 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b Sep 02 16:28:42 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:42 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:42 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info is being set with open permissions: ugo+rw Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:42 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info Sep 02 16:28:42 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:42 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b" returned: 0 in 0.741s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:42 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.info" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:42 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b Sep 02 16:28:42 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e1b1f28a-9dd6-44e5-a0da-60859cbec4cb tempest-SnapshotMetadataTestJSON-67382188 None] Create snapshot completed successfully Sep 02 16:28:43 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e.9088530b-b48d-40de-bfc4-cdf6067d366b" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-9088530b-b48d-40de-bfc4-cdf6067d366b" released by "_delete_snapshot" :: held 2.400s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" released by "delete_snapshot" :: held 2.439s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:43 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Created reservations ['9a0e239c-4143-489f-9893-c09324305110', 'ff6f5a58-caf4-4c20-8472-754488af6cf9', 'c3e69108-d5b3-434e-8ee6-b6b53a5fd4ad', 'e1d36d6b-411a-4326-a15b-fa127831f1af'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:43 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Delete snapshot completed successfully. Sep 02 16:28:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ad18d460-46f5-40b1-bd6f-95be75f62b8d tempest-CinderUnicodeTest-838024792 None] Lock "cinder-9088530b-b48d-40de-bfc4-cdf6067d366b-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-fba5e8c5-b2eb-4be6-9e71-52952cc3455e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "cinder-fba5e8c5-b2eb-4be6-9e71-52952cc3455e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb77be0-9be9-47e6-8f25-9cfb1a78b6ac]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "cinder-fac46218-2645-42a0-b5f0-0a90b9b6aa6c-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-fac46218-2645-42a0-b5f0-0a90b9b6aa6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:44 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e Sep 02 16:28:44 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "cinder-quobyte-fac46218-2645-42a0-b5f0-0a90b9b6aa6c" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-fac46218-2645-42a0-b5f0-0a90b9b6aa6c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Deleting offline snapshot fac46218-2645-42a0-b5f0-0a90b9b6aa6c of volume ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] snapshot_file for this snap is: volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2b62a-c84c-4281-969b-1f7acf0c702c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:44 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c Sep 02 16:28:44 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:44 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" returned: 0 in 0.621s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:44 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e Sep 02 16:28:44 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:45 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c" returned: 0 in 0.447s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba638a59-051d-48ef-b920-08c90de33b5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfb5d04-8f87-49dd-89d9-2fc48879186f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:45 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" returned: 0 in 0.284s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:45 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e Sep 02 16:28:45 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-fba5e8c5-b2eb-4be6-9e71-52952cc3455e" released by "delete_volume" :: held 1.012s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Created reservations ['0b507506-ea84-4445-8b72-2969feba8d38', 'af1fca4f-49c4-4e78-963a-4add6fa73db3', 'cb0acf9c-1680-4e3e-885c-1dfa34e77326', '82befbc0-87b5-470d-81bc-ecb0080d1ec6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:45 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:45 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:45 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e" returned: 0 in 0.530s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:45 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c Sep 02 16:28:45 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:45 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:45 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Deleted volume successfully. Sep 02 16:28:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-33abe440-e2f7-4264-af1a-7ee045fb649a tempest-CinderUnicodeTest-838024792 None] Lock "cinder-fba5e8c5-b2eb-4be6-9e71-52952cc3455e-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:46 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c" returned: 0 in 0.567s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:46 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c Sep 02 16:28:46 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-5bf95861-3c3d-4a4a-8307-e1286c1002a1-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "cinder-5bf95861-3c3d-4a4a-8307-e1286c1002a1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:46 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e.fac46218-2645-42a0-b5f0-0a90b9b6aa6c" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Acquiring lock "cinder-quobyte-5bf95861-3c3d-4a4a-8307-e1286c1002a1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-5bf95861-3c3d-4a4a-8307-e1286c1002a1" acquired by "delete_volume" :: waited 0.053s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-fac46218-2645-42a0-b5f0-0a90b9b6aa6c" released by "_delete_snapshot" :: held 2.123s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" released by "delete_snapshot" :: held 2.167s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd28e0-7d1c-461d-a6a6-71da431aa2bd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Created reservations ['c3aa24bc-879f-4c0a-9c1b-0b478bfc1700', '39aaa8c5-fb5b-4f9e-8a00-9894a8c720a8', 'f23f773d-d6b2-4a09-bbc2-427d9f7f6189', '959235c6-4eca-4c97-9c1b-deebed370ebf'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:46 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 Sep 02 16:28:46 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Delete snapshot completed successfully. Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cd9ffdbc-d443-4bdf-a56c-eab801421cd4 tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-fac46218-2645-42a0-b5f0-0a90b9b6aa6c-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:47 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1" returned: 0 in 0.489s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:47 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1 Sep 02 16:28:47 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:47 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5bf95861-3c3d-4a4a-8307-e1286c1002a1" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "cinder-quobyte-5bf95861-3c3d-4a4a-8307-e1286c1002a1" released by "delete_volume" :: held 0.860s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Created reservations ['d3e8d941-0ff8-4d05-a87a-90eec4048f80', '0fd21bf3-bf15-4abc-80db-c8a04c336aae', '17e97767-0776-4049-bd1b-be68f8b9f710', '93970229-91b1-4052-bec2-5698419a454e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:47 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:47 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "cinder-ba638a59-051d-48ef-b920-08c90de33b5e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-ba638a59-051d-48ef-b920-08c90de33b5e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e5e6c-22cb-4042-a22e-1690d097a43d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:48 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.623s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:48 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e Sep 02 16:28:48 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Deleted volume successfully. Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aadd8c4a-1c6d-4767-8327-b04e118aafb0 tempest-CinderUnicodeTest-838024792 None] Lock "cinder-5bf95861-3c3d-4a4a-8307-e1286c1002a1-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:28:48 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e" returned: 0 in 0.585s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:48 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e Sep 02 16:28:48 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:49 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ba638a59-051d-48ef-b920-08c90de33b5e" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-quobyte-ba638a59-051d-48ef-b920-08c90de33b5e" released by "delete_volume" :: held 1.113s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Created reservations ['28d508e5-11b0-4679-9069-06a898fd60b4', '66442e55-48b1-4280-b3a1-58a63b00e1a8', 'c695f656-6380-44ca-ac39-67fbd4752c0f', '7f864c17-1120-40a1-9b4f-73a180821f0c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:49 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:49 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:49 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Deleted volume successfully. Sep 02 16:28:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6f1faf78-d761-404e-9d70-25e6422c93cc tempest-SnapshotMetadataTestJSON-67382188 None] Lock "cinder-ba638a59-051d-48ef-b920-08c90de33b5e-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (bfdc218b-5477-47e7-bb66-5d67ff3d045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949c57f7-3c28-4829-80fa-60b5fe7bccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949c57f7-3c28-4829-80fa-60b5fe7bccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708758006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d52b7e-fbb1-465a-9239-dc0e15e20f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd5f1a94cfd41fcb85621104a3666c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:52Z,use_quota=True,user_id='a7f4f1b535384cd5bb6e68235dce2722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097883b4-da17-47a6-850d-7f5c3d1d8950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097883b4-da17-47a6-850d-7f5c3d1d8950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b23bf-b531-4fe2-a35c-b5dab0ace70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b23bf-b531-4fe2-a35c-b5dab0ace70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d52b7e-fbb1-465a-9239-dc0e15e20f90', 'volume_name': 'volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84457b7-9f4a-4420-a0e1-a1e1c7828ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84457b7-9f4a-4420-a0e1-a1e1c7828ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a255031-e09f-4e9e-8395-a830ec87ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90', 'volume_size': 1} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708758006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d52b7e-fbb1-465a-9239-dc0e15e20f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd5f1a94cfd41fcb85621104a3666c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:52Z,use_quota=True,user_id='a7f4f1b535384cd5bb6e68235dce2722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Creating volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:51 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:51 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 1073741824 Sep 02 16:28:51 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:52 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 1073741824" returned: 0 in 0.713s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:52 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:28:52 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:52 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.317s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a255031-e09f-4e9e-8395-a830ec87ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60efcbdc-2007-40b9-baf3-5c4f089a57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:52 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Volume volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 (e5d52b7e-fbb1-465a-9239-dc0e15e20f90): created successfully Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60efcbdc-2007-40b9-baf3-5c4f089a57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:52 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (bfdc218b-5477-47e7-bb66-5d67ff3d045a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:52 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a386aa19-f266-4ab1-a118-57ff29462fc0 tempest-VolumesDeleteCascade-287628385 None] Created volume successfully. Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Flow 'volume_create_manager' (7bb2afc7-944f-4fec-941e-e8eed7569f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718f9fc9-dc72-4fd8-901d-9a75aed72e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718f9fc9-dc72-4fd8-901d-9a75aed72e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414779156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4ee9ae-ed75-46de-b82e-6862502da9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2739ef433af148ba963555ed3a410ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:53Z,use_quota=True,user_id='b3da878fbf4f49b593fc1408819e7405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dd9de9-886b-4eee-a86a-48f6f66f4410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dd9de9-886b-4eee-a86a-48f6f66f4410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf4f11-0845-4a6f-8288-50942cf39691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf4f11-0845-4a6f-8288-50942cf39691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4ee9ae-ed75-46de-b82e-6862502da9f7', 'volume_name': 'volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca201be2-aa6b-45c5-93e3-56941189b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca201be2-aa6b-45c5-93e3-56941189b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be23ac8e-37d3-4966-b045-6fe982de3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Volume 3d4ee9ae-ed75-46de-b82e-6862502da9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7', 'volume_size': 1} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414779156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4ee9ae-ed75-46de-b82e-6862502da9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2739ef433af148ba963555ed3a410ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:53Z,use_quota=True,user_id='b3da878fbf4f49b593fc1408819e7405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Creating volume 3d4ee9ae-ed75-46de-b82e-6862502da9f7 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:53 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:53 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 1073741824 Sep 02 16:28:53 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:53 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 1073741824" returned: 0 in 0.500s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:54 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 Sep 02 16:28:54 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:54 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7" returned: 0 in 0.252s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be23ac8e-37d3-4966-b045-6fe982de3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2cad2-c83a-43aa-951b-00d1d55b39dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Creating offline snapshot d9fe640a-3a26-4b89-9047-f4cf0c18f73e of volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:28:54 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Volume volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 (3d4ee9ae-ed75-46de-b82e-6862502da9f7): created successfully Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2cad2-c83a-43aa-951b-00d1d55b39dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Flow 'volume_create_manager' (7bb2afc7-944f-4fec-941e-e8eed7569f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79d0d12-7881-4a69-958c-c1b0e4c881c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e259aa8f-4bde-4e69-8773-e66d52708787 tempest-ProjectReaderTests-1240032926 None] Created volume successfully. Sep 02 16:28:54 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:28:54 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:54 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:54 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e 1G Sep 02 16:28:54 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:55 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e 1G" returned: 0 in 0.402s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:55 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:28:55 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:55 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:55 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e is being set with open permissions: ugo+rw Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:55 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:28:55 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Flow 'volume_create_manager' (d757c0f3-af4d-49b8-9b6c-660e46413e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de174647-7c60-40aa-8ac6-b8f404ba525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de174647-7c60-40aa-8ac6-b8f404ba525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1617725644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52c07bd-6a5e-4e32-941b-1aa7aa26c651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f99495c69d464880616aabeb0fe53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:56Z,use_quota=True,user_id='c0ebe036c9ef44c9a96acd33655529a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca7db8b-119b-4a69-81a3-543a0567399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca7db8b-119b-4a69-81a3-543a0567399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32950ab4-85b3-4eef-b9aa-063754d06d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32950ab4-85b3-4eef-b9aa-063754d06d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52c07bd-6a5e-4e32-941b-1aa7aa26c651', 'volume_name': 'volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb9d259-bff1-41be-8535-24a30922545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb9d259-bff1-41be-8535-24a30922545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5dfce-c916-4b72-8cee-40f026c10df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Volume f52c07bd-6a5e-4e32-941b-1aa7aa26c651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651', 'volume_size': 1} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "cinder-3d4ee9ae-ed75-46de-b82e-6862502da9f7-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-3d4ee9ae-ed75-46de-b82e-6862502da9f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "cinder-quobyte-3d4ee9ae-ed75-46de-b82e-6862502da9f7" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-quobyte-3d4ee9ae-ed75-46de-b82e-6862502da9f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0dc4e1-dc07-4878-a81c-c5ac2b281073]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:55 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.287s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:55 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info Sep 02 16:28:55 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:55 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 Sep 02 16:28:55 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:56 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info is being set with open permissions: ugo+rw Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:56 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info Sep 02 16:28:56 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:56 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7" returned: 0 in 0.368s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:56 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7 Sep 02 16:28:56 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:56 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.info" returned: 0 in 0.248s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1617725644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52c07bd-6a5e-4e32-941b-1aa7aa26c651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f99495c69d464880616aabeb0fe53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:56Z,use_quota=True,user_id='c0ebe036c9ef44c9a96acd33655529a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Creating volume f52c07bd-6a5e-4e32-941b-1aa7aa26c651 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:56 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:56 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3d4ee9ae-ed75-46de-b82e-6862502da9f7" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 1073741824 Sep 02 16:28:56 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-quobyte-3d4ee9ae-ed75-46de-b82e-6862502da9f7" released by "delete_volume" :: held 0.663s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8009efac-7618-4192-b671-9abbb8ef75e1 tempest-VolumesDeleteCascade-287628385 None] Create snapshot completed successfully Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Created reservations ['e1de3ac4-bc5c-4a4b-96c0-111a14bfcc89', '17c55196-6004-457f-bd17-7c287f8d2461', '6d74ac66-dbda-4a19-af2b-27b132721638', '2e8f42cb-68e3-4ced-b31c-92fea16f7ef2'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:56 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:28:56 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:56 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 1073741824" returned: 0 in 0.409s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:28:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Deleted volume successfully. Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-55806072-2c9b-42ab-9ce0-ee56f48df634 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-3d4ee9ae-ed75-46de-b82e-6862502da9f7-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:56 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 Sep 02 16:28:56 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:57 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5dfce-c916-4b72-8cee-40f026c10df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefd1e0-6071-45bb-9c1d-43f1c19542b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Volume volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 (f52c07bd-6a5e-4e32-941b-1aa7aa26c651): created successfully Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefd1e0-6071-45bb-9c1d-43f1c19542b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Flow 'volume_create_manager' (d757c0f3-af4d-49b8-9b6c-660e46413e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-38d52ca7-03b6-4a9d-8171-00e9afd38b10 tempest-VolumesTransfersV357Test-1896220389 None] Created volume successfully. Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Creating offline snapshot ebbc8f32-3f0f-4704-96f1-771fa4195755 of volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Flow 'volume_create_manager' (56120589-f90d-4c92-adae-288185ea13a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d93c92-7d8b-47ed-a6b9-0a3fe3600a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ba5506-3d73-46c7-8f88-e8a88dde099f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d93c92-7d8b-47ed-a6b9-0a3fe3600a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2080299579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc072871-6504-4e6b-b601-d444522363b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2739ef433af148ba963555ed3a410ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:57Z,use_quota=True,user_id='b3da878fbf4f49b593fc1408819e7405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8374731a-6dab-4d29-a63e-3c6ae01f8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8374731a-6dab-4d29-a63e-3c6ae01f8639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c14f67e-bc9d-4ebf-8091-5c515464d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c14f67e-bc9d-4ebf-8091-5c515464d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc072871-6504-4e6b-b601-d444522363b8', 'volume_name': 'volume-cc072871-6504-4e6b-b601-d444522363b8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90fc13-d8d3-4162-a3fd-a12ceb841e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90fc13-d8d3-4162-a3fd-a12ceb841e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eda33a6-e439-49cd-a108-06645026cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:28:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Volume cc072871-6504-4e6b-b601-d444522363b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc072871-6504-4e6b-b601-d444522363b8', 'volume_size': 1} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:57 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:28:57 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:57 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:28:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:57 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 1G Sep 02 16:28:57 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-62f1c82e-bab0-45c2-9f34-9130f1d0f922 tempest-VolumesTransfersV357Test-574794836 None] Transfer volume completed successfully. Sep 02 16:28:58 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 1G" returned: 0 in 0.577s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:58 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:28:58 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "cinder-f52c07bd-6a5e-4e32-941b-1aa7aa26c651-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-f52c07bd-6a5e-4e32-941b-1aa7aa26c651-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "cinder-quobyte-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-quobyte-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:58 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:58 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 is being set with open permissions: ugo+rw Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde47949-b5ba-4c8d-9fdb-aeaf8bf2b8cf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:58 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:28:58 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:59 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 Sep 02 16:28:59 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:59 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2080299579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc072871-6504-4e6b-b601-d444522363b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2739ef433af148ba963555ed3a410ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:28:57Z,use_quota=True,user_id='b3da878fbf4f49b593fc1408819e7405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Creating volume cc072871-6504-4e6b-b601-d444522363b8 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:28:59 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:59 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 1073741824 Sep 02 16:28:59 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b583085d-a840-4643-8a71-a51f3025c446 tempest-VolumesDeleteCascade-287628385 None] Create snapshot completed successfully Sep 02 16:28:59 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" returned: 0 in 0.435s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:59 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651 Sep 02 16:28:59 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-e5d52b7e-fbb1-465a-9239-dc0e15e20f90-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-e5d52b7e-fbb1-465a-9239-dc0e15e20f90-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:59 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Performing cascade delete. {{(pid=87051) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-quobyte-f52c07bd-6a5e-4e32-941b-1aa7aa26c651" released by "delete_volume" :: held 0.877s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:28:59 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-d9fe640a-3a26-4b89-9047-f4cf0c18f73e-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 1073741824" returned: 0 in 0.556s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-d9fe640a-3a26-4b89-9047-f4cf0c18f73e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:59 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-d9fe640a-3a26-4b89-9047-f4cf0c18f73e" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:28:59 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Created reservations ['a5c4af7f-c7ad-43b8-ba45-8d0ff0caf35a', '007b36af-e5e5-41b6-bb4b-3283b7595db7', '0e6f92da-2836-415a-9b93-bc176a09d7eb', '2a1d5e01-eac5-4f58-9597-3058368d968a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-d9fe640a-3a26-4b89-9047-f4cf0c18f73e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Deleting offline snapshot d9fe640a-3a26-4b89-9047-f4cf0c18f73e of volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] snapshot_file for this snap is: volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b067d3-cb0e-47b3-be2e-fa7bf7122737]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:28:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:00 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:00 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:00 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:29:00 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:00 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eda33a6-e439-49cd-a108-06645026cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc072871-6504-4e6b-b601-d444522363b8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cd95ca-2029-4564-b032-312a95934c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Volume volume-cc072871-6504-4e6b-b601-d444522363b8 (cc072871-6504-4e6b-b601-d444522363b8): created successfully Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cd95ca-2029-4564-b032-312a95934c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Flow 'volume_create_manager' (56120589-f90d-4c92-adae-288185ea13a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ab001ece-4acd-49de-8d47-f81e6887a389 tempest-ProjectReaderTests-1240032926 None] Created volume successfully. Sep 02 16:29:00 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.274s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Deleted volume successfully. Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d870bbd2-0857-4488-9a52-d4917f978e77 tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-f52c07bd-6a5e-4e32-941b-1aa7aa26c651-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:00 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.450s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44bcbf2-bbe0-4428-8dd8-473e97a67440]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:00 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:29:00 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "cinder-cc072871-6504-4e6b-b601-d444522363b8-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-cc072871-6504-4e6b-b601-d444522363b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "cinder-quobyte-cc072871-6504-4e6b-b601-d444522363b8" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-quobyte-cc072871-6504-4e6b-b601-d444522363b8" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c48d44-e8e5-4f78-8aa1-4d8a70387ca9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:00 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.409s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:00 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 Sep 02 16:29:00 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8285ae-daac-4b76-bccf-cce7aea06299]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:00 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:29:00 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:01 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8 Sep 02 16:29:01 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7977c162-c44e-4857-a69e-4da52365c211]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:01 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cc072871-6504-4e6b-b601-d444522363b8" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:01 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:29:01 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-quobyte-cc072871-6504-4e6b-b601-d444522363b8" released by "delete_volume" :: held 0.721s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Created reservations ['250a8aae-12d5-4ab7-a871-9c98c9d5a5c2', '4003f515-6281-4c48-861d-5125692253c6', '8a482d29-f93a-4d0d-a74e-ac4f38c38f57', '0bfaa81e-0a47-4580-82af-855ba5cc988b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:01 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:01 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Flow 'volume_create_manager' (7c18c040-b8a6-4523-ac58-78ca20520b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693a5bf-cbdb-47e2-bb18-a9309913a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693a5bf-cbdb-47e2-bb18-a9309913a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1542045281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12bb61-4fd6-4883-ab17-3ff81a3329ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f99495c69d464880616aabeb0fe53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:02Z,use_quota=True,user_id='c0ebe036c9ef44c9a96acd33655529a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad8a190-a6da-4089-a459-d9c9136ca56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad8a190-a6da-4089-a459-d9c9136ca56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd39c8b-fcdd-4447-9e29-47aadbb26b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd39c8b-fcdd-4447-9e29-47aadbb26b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed12bb61-4fd6-4883-ab17-3ff81a3329ce', 'volume_name': 'volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b380d79d-a56a-4cb1-8070-78cad3d3d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b380d79d-a56a-4cb1-8070-78cad3d3d670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe607967-f0a8-49cb-86ef-665f79bd60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Volume ed12bb61-4fd6-4883-ab17-3ff81a3329ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce', 'volume_size': 1} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1542045281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12bb61-4fd6-4883-ab17-3ff81a3329ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f99495c69d464880616aabeb0fe53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:02Z,use_quota=True,user_id='c0ebe036c9ef44c9a96acd33655529a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Creating volume ed12bb61-4fd6-4883-ab17-3ff81a3329ce {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:01 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:01 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.440s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:01 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce 1073741824 Sep 02 16:29:01 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d85fb0-7c3b-4dde-b7c7-10a866d91102]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:01 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Deleted volume successfully. Sep 02 16:29:01 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:29:01 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-201cb161-6d7b-437a-8ee7-a954caa559f3 tempest-ProjectReaderTests-1240032926 None] Lock "cinder-cc072871-6504-4e6b-b601-d444522363b8-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:02 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:02 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce 1073741824" returned: 0 in 0.503s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:02 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:29:02 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:02 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce Sep 02 16:29:02 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:02 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe607967-f0a8-49cb-86ef-665f79bd60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509bd16-599c-4e94-acee-ed2224cbd0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:02 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:02 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Volume volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce (ed12bb61-4fd6-4883-ab17-3ff81a3329ce): created successfully Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509bd16-599c-4e94-acee-ed2224cbd0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:02 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e Sep 02 16:29:02 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Flow 'volume_create_manager' (7c18c040-b8a6-4523-ac58-78ca20520b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-37705314-384c-43ab-8d6e-748825a929f1 tempest-VolumesTransfersV357Test-1896220389 None] Created volume successfully. Sep 02 16:29:02 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.d9fe640a-3a26-4b89-9047-f4cf0c18f73e" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 -F qcow2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:02 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 -F qcow2 Sep 02 16:29:02 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:03 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 -F qcow2" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-d9fe640a-3a26-4b89-9047-f4cf0c18f73e" released by "_delete_snapshot" :: held 3.393s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" released by "delete_snapshot" :: held 3.432s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Created reservations ['b85fdc20-4956-40a2-9bf7-3278778b2344', '66a4725d-e3dc-4dce-bc08-28629bb0ae63', '61e87d75-b9a7-4e07-8c1f-3f61d16909d7', '06663137-e75d-473b-b7e0-6d396c8d0a34'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Delete snapshot completed successfully. Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-d9fe640a-3a26-4b89-9047-f4cf0c18f73e-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-ebbc8f32-3f0f-4704-96f1-771fa4195755-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-ebbc8f32-3f0f-4704-96f1-771fa4195755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-ebbc8f32-3f0f-4704-96f1-771fa4195755" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebbc8f32-3f0f-4704-96f1-771fa4195755" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Deleting offline snapshot ebbc8f32-3f0f-4704-96f1-771fa4195755 of volume e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] snapshot_file for this snap is: volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc6347-6007-417c-907f-731cfc47e339]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:03 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:29:03 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:04 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Flow 'volume_create_manager' (4746945d-e03d-4239-acf8-4d8d10910e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7333fc9-fc29-4c03-b4bf-cc24ffb9e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.518s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7333fc9-fc29-4c03-b4bf-cc24ffb9e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1862177832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f08ecc-296e-46f5-bf79-267df2f86efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dac29a7e9f40358f40101beedea4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:04Z,use_quota=True,user_id='fade699b5dfe486bb896821e8a3bcd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d77ef2b-c2c1-472e-aa37-4078367154e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d77ef2b-c2c1-472e-aa37-4078367154e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0296eac-2f4c-44db-9b79-e0f4ba4180ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0296eac-2f4c-44db-9b79-e0f4ba4180ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f08ecc-296e-46f5-bf79-267df2f86efd', 'volume_name': 'volume-c8f08ecc-296e-46f5-bf79-267df2f86efd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd385c5-4d7d-4ea6-ab09-7bf516d9d175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd385c5-4d7d-4ea6-ab09-7bf516d9d175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126681f2-8a75-447c-869c-82f8539aa543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Volume c8f08ecc-296e-46f5-bf79-267df2f86efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f08ecc-296e-46f5-bf79-267df2f86efd', 'volume_size': 1} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1862177832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f08ecc-296e-46f5-bf79-267df2f86efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dac29a7e9f40358f40101beedea4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:04Z,use_quota=True,user_id='fade699b5dfe486bb896821e8a3bcd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Creating volume c8f08ecc-296e-46f5-bf79-267df2f86efd {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:04 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c9b2b-1a02-4c8b-a626-efcc65b41947]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "cinder-ed12bb61-4fd6-4883-ab17-3ff81a3329ce-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd 1073741824 Sep 02 16:29:04 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-ed12bb61-4fd6-4883-ab17-3ff81a3329ce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "cinder-quobyte-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-quobyte-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063afcc-1450-45b8-8f36-3e3605d884c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:29:04 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce Sep 02 16:29:04 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:04 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.497s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd 1073741824" returned: 0 in 0.544s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:04 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:29:04 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" returned: 0 in 0.441s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:04 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd Sep 02 16:29:04 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:04 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce Sep 02 16:29:04 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:05 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126681f2-8a75-447c-869c-82f8539aa543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f08ecc-296e-46f5-bf79-267df2f86efd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4a5401-f474-49b5-a577-1afaadfa5562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:05 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-quobyte-ed12bb61-4fd6-4883-ab17-3ff81a3329ce" released by "delete_volume" :: held 0.817s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Volume volume-c8f08ecc-296e-46f5-bf79-267df2f86efd (c8f08ecc-296e-46f5-bf79-267df2f86efd): created successfully Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4a5401-f474-49b5-a577-1afaadfa5562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Flow 'volume_create_manager' (4746945d-e03d-4239-acf8-4d8d10910e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ef71c1fe-0c7e-4815-9ffe-2abab06faf8b tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Created volume successfully. Sep 02 16:29:05 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.464s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:05 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755 Sep 02 16:29:05 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Created reservations ['db13b72b-4889-4d05-8894-a53e10636887', '4ddedfb8-30eb-4c36-9261-9c5e91ca9384', 'ac805022-150a-427b-9bdc-1d8d9ce9b21d', '91503628-8225-4cab-97e3-85edff3abeb6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:05 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:05 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:05 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90.ebbc8f32-3f0f-4704-96f1-771fa4195755" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebbc8f32-3f0f-4704-96f1-771fa4195755" released by "_delete_snapshot" :: held 2.043s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" released by "delete_snapshot" :: held 2.078s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Created reservations ['cd0bbdc3-bd5e-4c16-8fad-924bfee8ef67', 'bcb47ae2-3a0b-4932-8c29-43922ed58095', 'b54e7f57-a29a-4706-a309-2021e747243e', 'd129a45f-a859-4908-a265-684d2030be95'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:05 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Deleted volume successfully. Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b690535c-b5a2-4961-896d-278cb9421a0f tempest-VolumesTransfersV357Test-135122433 None] Lock "cinder-ed12bb61-4fd6-4883-ab17-3ff81a3329ce-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Delete snapshot completed successfully. Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-ebbc8f32-3f0f-4704-96f1-771fa4195755-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Snapshots deleted, issuing volume delete {{(pid=87051) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[612bb28f-d01b-4d87-9021-9c8ff3c70339]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:05 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:29:05 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:06 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.467s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:06 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90 Sep 02 16:29:06 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:06 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" returned: 0 in 0.346s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-e5d52b7e-fbb1-465a-9239-dc0e15e20f90" released by "delete_volume" :: held 0.902s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Created reservations ['38a8c6c4-b717-4e77-ae8a-ca8b3c92cea2', '19a58fe0-62cb-4b02-a695-439938f71d6e', '4d48a7a5-cc9c-4a3f-8fdd-f615bad6edac', '05b32378-8baf-492f-82c2-3ae6f0418edc'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:06 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:06 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:07 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Deleted volume successfully. Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e7581c2a-5f9f-4071-a740-edb2d37aec65 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-e5d52b7e-fbb1-465a-9239-dc0e15e20f90-delete_volume" released by "delete_volume" :: held 7.603s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-dcc0d7ac-657a-4c30-8890-49ec3848fe29 req-9ab236f5-2c15-4b6d-a211-c4f49590a78a tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-dcc0d7ac-657a-4c30-8890-49ec3848fe29 req-9ab236f5-2c15-4b6d-a211-c4f49590a78a tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-dcc0d7ac-657a-4c30-8890-49ec3848fe29 req-9ab236f5-2c15-4b6d-a211-c4f49590a78a tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-dcc0d7ac-657a-4c30-8890-49ec3848fe29 req-9ab236f5-2c15-4b6d-a211-c4f49590a78a tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-c8f08ecc-296e-46f5-bf79-267df2f86efd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f257402f-7c69-460f-9629-860f3da434c9', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:29:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-dcc0d7ac-657a-4c30-8890-49ec3848fe29 req-9ab236f5-2c15-4b6d-a211-c4f49590a78a tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] attachment_update completed successfully. Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (2e330068-74cb-479a-bced-8a93b5e45c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf617b-6372-4ba8-8155-905eb5e5bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf617b-6372-4ba8-8155-905eb5e5bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1112729602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf305b9-64e6-4dd6-89c5-ff326b1a1003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd5f1a94cfd41fcb85621104a3666c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:08Z,use_quota=True,user_id='a7f4f1b535384cd5bb6e68235dce2722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6de1bca-2ad6-4886-baf9-0899820eff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6de1bca-2ad6-4886-baf9-0899820eff6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e46afbf-472d-4036-b58c-7bdf503ea1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e46afbf-472d-4036-b58c-7bdf503ea1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf305b9-64e6-4dd6-89c5-ff326b1a1003', 'volume_name': 'volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4daa60e-7fc9-4f25-a0b9-a186c3610fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4daa60e-7fc9-4f25-a0b9-a186c3610fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e237ac-a76e-40f5-b820-5ebcf0e9432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:08 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Volume ebf305b9-64e6-4dd6-89c5-ff326b1a1003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003', 'volume_size': 1} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1112729602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf305b9-64e6-4dd6-89c5-ff326b1a1003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd5f1a94cfd41fcb85621104a3666c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:08Z,use_quota=True,user_id='a7f4f1b535384cd5bb6e68235dce2722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Creating volume ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:08 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:08 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 1073741824 Sep 02 16:29:08 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:08 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 1073741824" returned: 0 in 0.595s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:09 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:09 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:09 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e237ac-a76e-40f5-b820-5ebcf0e9432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b607e-6a82-4bd8-9af0-6af1f8728a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:09 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Volume volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 (ebf305b9-64e6-4dd6-89c5-ff326b1a1003): created successfully Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b607e-6a82-4bd8-9af0-6af1f8728a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (2e330068-74cb-479a-bced-8a93b5e45c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6b396279-4821-46d6-8586-9f3f15b3fcbf tempest-VolumesDeleteCascade-287628385 None] Created volume successfully. Sep 02 16:29:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Creating offline snapshot 2109be57-bae9-4dfb-8bac-6bcde505e20f of volume ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:29:10 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f3fbf-a594-41ce-8f71-033b8f22d837]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:10 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:10 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:11 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.517s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:11 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f 1G Sep 02 16:29:11 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:11 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f 1G" returned: 0 in 0.617s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:11 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:11 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-2e3e8b93-7a21-4c87-8ac7-14b9444a8cbc req-67ad650c-e158-44e4-8674-dadb5f0be72d tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Terminate volume connection completed successfully. Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-2e3e8b93-7a21-4c87-8ac7-14b9444a8cbc req-67ad650c-e158-44e4-8674-dadb5f0be72d tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Deleting attachment f257402f-7c69-460f-9629-860f3da434c9. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:29:12 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.442s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:12 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f is being set with open permissions: ugo+rw Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:12 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:12 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:12 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.372s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:12 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info Sep 02 16:29:12 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (c9dc782c-5580-4523-afa1-21e60b779f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06dcff0-6018-4947-bc15-f38152b517b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06dcff0-6018-4947-bc15-f38152b517b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2017095693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c870e4b-d6e0-49da-83d1-49a9a28e1f2c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:13Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5638858c-78b4-4171-abfb-cf291ea30845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5638858c-78b4-4171-abfb-cf291ea30845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0ccbf4-dab6-42b9-97c7-f02697e7ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0ccbf4-dab6-42b9-97c7-f02697e7ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c870e4b-d6e0-49da-83d1-49a9a28e1f2c', 'volume_name': 'volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97ff3c6-b34e-4860-bfdf-581d8ddf0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97ff3c6-b34e-4860-bfdf-581d8ddf0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed87909-74ec-46ea-9962-c819253fc9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Volume 8c870e4b-d6e0-49da-83d1-49a9a28e1f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c', 'volume_size': 1} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "cinder-c8f08ecc-296e-46f5-bf79-267df2f86efd-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "cinder-c8f08ecc-296e-46f5-bf79-267df2f86efd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:12 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info" returned: 0 in 0.335s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:12 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info is being set with open permissions: ugo+rw Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "cinder-quobyte-c8f08ecc-296e-46f5-bf79-267df2f86efd" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "cinder-quobyte-c8f08ecc-296e-46f5-bf79-267df2f86efd" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:12 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info Sep 02 16:29:12 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65a17c-3a7c-432c-90c2-e51c8d3bb935]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:13 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd Sep 02 16:29:13 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:13 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.info" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2017095693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c870e4b-d6e0-49da-83d1-49a9a28e1f2c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:13Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Creating volume 8c870e4b-d6e0-49da-83d1-49a9a28e1f2c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:13 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:13 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c 1073741824 Sep 02 16:29:13 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-27991706-563a-46e2-95bf-28a87e6621cf tempest-VolumesDeleteCascade-287628385 None] Create snapshot completed successfully Sep 02 16:29:13 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:13 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd Sep 02 16:29:13 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:13 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c8f08ecc-296e-46f5-bf79-267df2f86efd" returned: 0 in 0.316s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "cinder-quobyte-c8f08ecc-296e-46f5-bf79-267df2f86efd" released by "delete_volume" :: held 0.773s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Created reservations ['6e887e93-6fce-48de-a5e5-daabae5e4326', '6763efac-ebbf-41a9-93b3-5e8d6d8d03bf', '57ebfb94-ea7c-4799-8055-a1932c68da0f', '1b5875e5-98c1-408d-a800-264868192d5a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:13 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c 1073741824" returned: 0 in 0.554s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:13 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c Sep 02 16:29:13 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:13 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:13 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:14 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" returned: 0 in 0.323s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed87909-74ec-46ea-9962-c819253fc9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c4596-1162-4c6d-98b0-37c25f1e91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Volume volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c (8c870e4b-d6e0-49da-83d1-49a9a28e1f2c): created successfully Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c4596-1162-4c6d-98b0-37c25f1e91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (c9dc782c-5580-4523-afa1-21e60b779f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9d96a47b-db59-4e66-9279-7221a0abe442 tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:29:14 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.491s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Deleted volume successfully. Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9500bcf9-5c9b-431d-864c-650305b08d02 tempest-TestServerVolumeAttachScenarioOldVersion-1973720865 None] Lock "cinder-c8f08ecc-296e-46f5-bf79-267df2f86efd-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (03c59911-e8a4-49e2-9c56-e9a70222fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9cd7a5-b0a1-489b-92f6-5f8aa0447f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9cd7a5-b0a1-489b-92f6-5f8aa0447f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-68515000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3913f1-a76f-4f24-b245-820a60bef893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd5f1a94cfd41fcb85621104a3666c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2109be57-bae9-4dfb-8bac-6bcde505e20f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:14Z,use_quota=True,user_id='a7f4f1b535384cd5bb6e68235dce2722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b370a-614e-45d9-a4a7-e70490868d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b370a-614e-45d9-a4a7-e70490868d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca97a15e-c3c1-42c1-b427-4e81079762a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca97a15e-c3c1-42c1-b427-4e81079762a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a3913f1-a76f-4f24-b245-820a60bef893', 'volume_name': 'volume-6a3913f1-a76f-4f24-b245-820a60bef893', 'volume_size': 1, 'snapshot_id': '2109be57-bae9-4dfb-8bac-6bcde505e20f'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40127981-062b-4a35-9561-542de4c48513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40127981-062b-4a35-9561-542de4c48513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e03373-5356-4679-8e6a-cf4a02575376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Volume 6a3913f1-a76f-4f24-b245-820a60bef893: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a3913f1-a76f-4f24-b245-820a60bef893', 'volume_size': 1, 'snapshot_id': '2109be57-bae9-4dfb-8bac-6bcde505e20f'} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f-6a3913f1-a76f-4f24-b245-820a60bef893" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f-6a3913f1-a76f-4f24-b245-820a60bef893" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Creating volume 6a3913f1-a76f-4f24-b245-820a60bef893 from snapshot 2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] snapshot: 2109be57-bae9-4dfb-8bac-6bcde505e20f, volume: 6a3913f1-a76f-4f24-b245-820a60bef893, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d2b60-90c4-4aee-a5de-5b317b17de9c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:15 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:15 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:15 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.505s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce846c5-b622-40b0-836a-7b883ccb471e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:15 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:15 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (50a262e6-98e3-476c-975a-d311c9ace189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2375f4f7-1aee-46bc-b288-cdb2aa70e4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2375f4f7-1aee-46bc-b288-cdb2aa70e4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1214426094',display_name='tempest-VolumesGetTest-Volume-53115873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b9b20a-f363-4587-aab0-1c136743f311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:16Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0903817f-cb52-4905-b28f-ede24d658c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0903817f-cb52-4905-b28f-ede24d658c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff47d3cd-db4c-4166-abb2-cff9a6284c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff47d3cd-db4c-4166-abb2-cff9a6284c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b9b20a-f363-4587-aab0-1c136743f311', 'volume_name': 'volume-71b9b20a-f363-4587-aab0-1c136743f311', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7734c6-4014-45ff-be49-24d2528f1008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7734c6-4014-45ff-be49-24d2528f1008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:16 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa1441-b97b-4c15-a5bc-8bce756449af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Volume 71b9b20a-f363-4587-aab0-1c136743f311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b9b20a-f363-4587-aab0-1c136743f311', 'volume_size': 1} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.618s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:29:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:16 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 Sep 02 16:29:16 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:21 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893" returned: 0 in 5.615s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:21 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:29:21 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Converted 1024.00 MB image at 182.33 MB/s Sep 02 16:29:21 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 is being set with open permissions: ugo+rw Sep 02 16:29:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:21 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 Sep 02 16:29:21 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:21 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" released by "_copy_volume_from_snapshot" :: held 7.247s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f-6a3913f1-a76f-4f24-b245-820a60bef893" released by "_create_volume_from_snapshot" :: held 7.336s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.359s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.944s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1214426094',display_name='tempest-VolumesGetTest-Volume-53115873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b9b20a-f363-4587-aab0-1c136743f311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:16Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Creating volume 71b9b20a-f363-4587-aab0-1c136743f311 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:22 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 1073741824 Sep 02 16:29:22 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e03373-5356-4679-8e6a-cf4a02575376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3913f1-a76f-4f24-b245-820a60bef893', 'volume_size': 1, 'snapshot_id': '2109be57-bae9-4dfb-8bac-6bcde505e20f'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35401d6e-a1e3-4415-a39f-c55612841494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:22 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Volume volume-6a3913f1-a76f-4f24-b245-820a60bef893 (6a3913f1-a76f-4f24-b245-820a60bef893): created successfully Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35401d6e-a1e3-4415-a39f-c55612841494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Flow 'volume_create_manager' (03c59911-e8a4-49e2-9c56-e9a70222fd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ef08b649-4e97-4456-884e-f1a68805b51d tempest-VolumesDeleteCascade-287628385 None] Created volume successfully. Sep 02 16:29:22 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 1073741824" returned: 0 in 0.555s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:22 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 Sep 02 16:29:22 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-ebf305b9-64e6-4dd6-89c5-ff326b1a1003-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-ebf305b9-64e6-4dd6-89c5-ff326b1a1003-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Performing cascade delete. {{(pid=87051) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-2109be57-bae9-4dfb-8bac-6bcde505e20f-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-2109be57-bae9-4dfb-8bac-6bcde505e20f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Deleting offline snapshot 2109be57-bae9-4dfb-8bac-6bcde505e20f of volume ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] snapshot_file for this snap is: volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d2915-f7d9-4e46-b273-b93de1facbdd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:23 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311" returned: 0 in 0.434s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa1441-b97b-4c15-a5bc-8bce756449af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b9b20a-f363-4587-aab0-1c136743f311', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f830aafe-78ea-492f-8657-d9320599e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Volume volume-71b9b20a-f363-4587-aab0-1c136743f311 (71b9b20a-f363-4587-aab0-1c136743f311): created successfully Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f830aafe-78ea-492f-8657-d9320599e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (50a262e6-98e3-476c-975a-d311c9ace189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b8eb2837-db54-4775-b5fd-223c62f53cc8 tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:29:23 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:23 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:23 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.429s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded38ecd-5571-43cb-a77f-a43787e8252b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:23 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:23 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-71b9b20a-f363-4587-aab0-1c136743f311-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "cinder-71b9b20a-f363-4587-aab0-1c136743f311-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-71b9b20a-f363-4587-aab0-1c136743f311" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-71b9b20a-f363-4587-aab0-1c136743f311" acquired by "delete_volume" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893fbcf-6a6f-4628-8634-f3f94bb1f721]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:24 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.755s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:24 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:24 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:24 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 Sep 02 16:29:24 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:24 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311" returned: 0 in 0.479s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:24 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311 Sep 02 16:29:24 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:24 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.551s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:24 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f Sep 02 16:29:24 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:24 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-71b9b20a-f363-4587-aab0-1c136743f311" returned: 0 in 0.328s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-71b9b20a-f363-4587-aab0-1c136743f311" released by "delete_volume" :: held 0.878s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:25 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003.2109be57-bae9-4dfb-8bac-6bcde505e20f" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Created reservations ['e475d604-c8c3-434f-bbd3-be25b88cd6b4', '50739564-7dc0-4731-9a0b-f46da79cee32', 'f2a63113-5fa5-4633-b090-075e5c7acb61', '29a3a43c-1351-4877-85f9-ccfb3dc70229'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-2109be57-bae9-4dfb-8bac-6bcde505e20f" released by "_delete_snapshot" :: held 2.171s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" released by "delete_snapshot" :: held 2.209s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Created reservations ['bb6fb110-219e-4d3b-8816-9d97e0c9a2c8', 'c2cb6554-3d74-48b8-a98b-544477d7f59e', '2f23e775-0ea7-4d46-835b-4fb9f56da874', 'e1bf40f5-c5cf-4f5d-b007-2ed4a69ab9e4'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:25 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:25 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Delete snapshot completed successfully. Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-2109be57-bae9-4dfb-8bac-6bcde505e20f-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Snapshots deleted, issuing volume delete {{(pid=87051) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "cinder-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3afc81-d01f-4590-8340-018a47433e3a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7760f7-10ca-4698-a87d-b5cfa9fc7860]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:25 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.422s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:29:25 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:25 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-31a40474-c527-4020-b26f-4d86df04ebb8 tempest-VolumesGetTest-2067660652 None] Lock "cinder-71b9b20a-f363-4587-aab0-1c136743f311-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:25 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c Sep 02 16:29:25 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:26 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.533s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:26 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003 Sep 02 16:29:26 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:26 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" returned: 0 in 0.483s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:26 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c Sep 02 16:29:26 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:26 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-ebf305b9-64e6-4dd6-89c5-ff326b1a1003" released by "delete_volume" :: held 1.049s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:26 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c" released by "delete_volume" :: held 0.889s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Created reservations ['1760540a-ff03-4c41-916e-795018354c24', '0e377236-fedc-455f-8fcb-5b7d1fc6cb02', '41e15e17-40ab-46d1-85a9-b6605dfb2a2f', 'fe7ceffa-d668-4694-84a4-d611b90076d6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Created reservations ['9990ca26-0325-4680-8b87-4a23010699b5', '3d08d066-636d-4a85-89d7-f852bcd1ae9d', 'cf0dd84a-f61e-4dc7-8846-1be1622eb148', '54623408-f22f-49e4-9a66-d272b0db3982'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:26 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:26 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:26 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:26 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:27 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.323s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1de895b-bb5b-4b2d-9455-95e986046788 tempest-VolumesGetTest-2067660652 None] Lock "cinder-8c870e4b-d6e0-49da-83d1-49a9a28e1f2c-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:27 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.465s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Deleted volume successfully. Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-dc1be633-d59e-4368-9ce7-352db9e42dea tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-ebf305b9-64e6-4dd6-89c5-ff326b1a1003-delete_volume" released by "delete_volume" :: held 4.459s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-6a3913f1-a76f-4f24-b245-820a60bef893-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-6a3913f1-a76f-4f24-b245-820a60bef893-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb9472-6bcf-4ef7-9f85-15ce6410246e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:27 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 Sep 02 16:29:27 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:28 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893" returned: 0 in 0.486s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:28 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893 Sep 02 16:29:28 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (cebf5297-68a5-45b0-89c9-5cce396a53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818b6fb6-9f5f-465c-b99d-9826c1d0d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:28 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6a3913f1-a76f-4f24-b245-820a60bef893" returned: 0 in 0.312s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818b6fb6-9f5f-465c-b99d-9826c1d0d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-692645977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3015b50-2838-4caa-a466-cb1a78b5cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:28Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f8ca7-74ad-4e5a-a957-737ad8cb3161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f8ca7-74ad-4e5a-a957-737ad8cb3161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7454bf-7af5-4ace-9888-2d8cdd03bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7454bf-7af5-4ace-9888-2d8cdd03bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3015b50-2838-4caa-a466-cb1a78b5cc31', 'volume_name': 'volume-a3015b50-2838-4caa-a466-cb1a78b5cc31', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dd05eb-8658-4fae-948c-b01323ae35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dd05eb-8658-4fae-948c-b01323ae35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f44efae-78b9-4b5e-8315-30dd55739414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:28 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Volume a3015b50-2838-4caa-a466-cb1a78b5cc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3015b50-2838-4caa-a466-cb1a78b5cc31', 'volume_size': 1} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-692645977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3015b50-2838-4caa-a466-cb1a78b5cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:28Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Creating volume a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:28 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-quobyte-6a3913f1-a76f-4f24-b245-820a60bef893" released by "delete_volume" :: held 0.929s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:28 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 1073741824 Sep 02 16:29:28 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Created reservations ['03e4b867-0808-477f-b962-3ab943119100', '48a77b59-0579-427c-b5ba-41250b51d16c', 'ed6c821d-d80f-4963-aeb8-7537d95c54a3', 'f00ffeef-f5ae-447e-906a-f38f55652017'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:28 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:28 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:29 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.357s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Deleted volume successfully. Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-69b12b4e-9c1f-4e74-aaf6-b62bc8d945c3 tempest-VolumesDeleteCascade-287628385 None] Lock "cinder-6a3913f1-a76f-4f24-b245-820a60bef893-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:29 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 1073741824" returned: 0 in 0.669s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:29 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:29 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:29 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f44efae-78b9-4b5e-8315-30dd55739414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3015b50-2838-4caa-a466-cb1a78b5cc31', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446942b5-c638-4cde-8a0f-8d19b8b29a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:29 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Volume volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 (a3015b50-2838-4caa-a466-cb1a78b5cc31): created successfully Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446942b5-c638-4cde-8a0f-8d19b8b29a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (cebf5297-68a5-45b0-89c9-5cce396a53ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0ab73284-f74f-4224-8127-c1eaf5b79f7d tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (42ddf7f8-1ae1-4e93-9791-4e24527f47c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fcfbfd-6adf-4043-9ae7-5088625a7476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fcfbfd-6adf-4043-9ae7-5088625a7476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-502174575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe7ee9d-e91b-475a-b2f7-45ede30b56f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a3015b50-2838-4caa-a466-cb1a78b5cc31,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:31Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9b94a3-130b-483d-8e82-41461b31dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9b94a3-130b-483d-8e82-41461b31dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fde535-8451-4e3d-a014-5234c08872e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fde535-8451-4e3d-a014-5234c08872e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7fe7ee9d-e91b-475a-b2f7-45ede30b56f2', 'volume_name': 'volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2', 'volume_size': 1, 'source_volid': 'a3015b50-2838-4caa-a466-cb1a78b5cc31', 'source_volstatus': 'available'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd3fdb0-117f-497e-be0d-ffc48713f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd3fdb0-117f-497e-be0d-ffc48713f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf6ca3-e377-48f0-81d9-17bf7b3f7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Volume 7fe7ee9d-e91b-475a-b2f7-45ede30b56f2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2', 'volume_size': 1, 'source_volid': 'a3015b50-2838-4caa-a466-cb1a78b5cc31', 'source_volstatus': 'available'} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:31 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Cloning volume a3015b50-2838-4caa-a466-cb1a78b5cc31 to volume 7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Creating offline snapshot 773110b6-4244-4857-b6a1-3f3639e38054 of volume a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5b517-016f-46ee-9225-e83426e0cdf7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:31 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:31 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:32 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.519s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:32 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 1G Sep 02 16:29:32 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:32 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 1G" returned: 0 in 0.574s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:32 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:32 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:33 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.442s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:33 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 is being set with open permissions: ugo+rw Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:33 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:33 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Flow 'volume_create_manager' (6e4e9bbc-b67e-4a1c-ac3e-3c7c52a48d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55ac20a-5e40-48cc-b0ae-9452d256bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:33 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55ac20a-5e40-48cc-b0ae-9452d256bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-263370718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d443c47-c92d-4a8e-974b-2db8b9b430b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb57fc9d14b74e61bb30f6a7dc303b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:33Z,use_quota=True,user_id='e9b40b72aca04f3ab2225759b7a809a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db21091-4057-4818-9056-0acd00a97a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db21091-4057-4818-9056-0acd00a97a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc8cce-a567-451b-9f7d-752fdac4bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc8cce-a567-451b-9f7d-752fdac4bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d443c47-c92d-4a8e-974b-2db8b9b430b8', 'volume_name': 'volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33b7e33-1e4b-4bf0-aaf3-07c8d3534a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33b7e33-1e4b-4bf0-aaf3-07c8d3534a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa866093-1a23-47ad-9ee0-115e9a1a7623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:33 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Volume 4d443c47-c92d-4a8e-974b-2db8b9b430b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8', 'volume_size': 1} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:33 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info Sep 02 16:29:33 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:33 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info" returned: 0 in 0.281s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:33 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info is being set with open permissions: ugo+rw Sep 02 16:29:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:33 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info Sep 02 16:29:33 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:34 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.info" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] snapshot: 773110b6-4244-4857-b6a1-3f3639e38054, volume: 7fe7ee9d-e91b-475a-b2f7-45ede30b56f2, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1aa21f-802c-4df9-8b39-d36d9ac9ff84]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:34 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:34 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:34 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.530s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3015b50-2838-4caa-a466-cb1a78b5cc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84edb1f-e34b-4bb9-afd1-1f3f1b99748e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:34 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:34 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:35 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:29:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:29:35 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:29:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:35 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 Sep 02 16:29:35 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:41 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" returned: 0 in 6.002s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:29:41 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Converted 1024.00 MB image at 170.58 MB/s Sep 02 16:29:41 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 is being set with open permissions: ugo+rw Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:41 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 Sep 02 16:29:41 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:41 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" returned: 0 in 0.333s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" released by "_copy_volume_from_snapshot" :: held 7.363s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=147,cinder:DELETE=12,cinder:INSERT=50,cinder:UPDATE=163 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-773110b6-4244-4857-b6a1-3f3639e38054" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-773110b6-4244-4857-b6a1-3f3639e38054" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Deleting offline snapshot 773110b6-4244-4857-b6a1-3f3639e38054 of volume a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] snapshot_file for this snap is: volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6bee54-60c4-4dcc-8e02-a00345a96899]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:41 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:41 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:41 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3015b50-2838-4caa-a466-cb1a78b5cc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f10b2-ec7c-44c2-ad13-5794e450aea0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:42 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:42 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:42 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.622s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:42 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:42 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:42 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:43 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054 Sep 02 16:29:43 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:43 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31.773110b6-4244-4857-b6a1-3f3639e38054" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-773110b6-4244-4857-b6a1-3f3639e38054" released by "_delete_snapshot" :: held 1.956s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=140,cinder:UPDATE=186,cinder:INSERT=39,cinder:DELETE=17 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.029s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.026s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-263370718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d443c47-c92d-4a8e-974b-2db8b9b430b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb57fc9d14b74e61bb30f6a7dc303b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:33Z,use_quota=True,user_id='e9b40b72aca04f3ab2225759b7a809a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Creating volume 4d443c47-c92d-4a8e-974b-2db8b9b430b8 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:43 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:43 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 1073741824 Sep 02 16:29:43 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf6ca3-e377-48f0-81d9-17bf7b3f7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2', 'volume_size': 1, 'source_volid': 'a3015b50-2838-4caa-a466-cb1a78b5cc31', 'source_volstatus': 'available'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb67cb6-de93-4277-b997-85f8a1719ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:43 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Volume volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 (7fe7ee9d-e91b-475a-b2f7-45ede30b56f2): created successfully Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb67cb6-de93-4277-b997-85f8a1719ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (42ddf7f8-1ae1-4e93-9791-4e24527f47c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:43 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-601a18de-8432-4b25-8fe7-720ecfc9dddb tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:29:44 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 1073741824" returned: 0 in 0.560s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:44 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 Sep 02 16:29:44 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:44 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8" returned: 0 in 0.320s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa866093-1a23-47ad-9ee0-115e9a1a7623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef10642-017e-42b6-ac80-90b664192159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:44 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Volume volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 (4d443c47-c92d-4a8e-974b-2db8b9b430b8): created successfully Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef10642-017e-42b6-ac80-90b664192159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Flow 'volume_create_manager' (6e4e9bbc-b67e-4a1c-ac3e-3c7c52a48d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c35615a0-d85b-449e-938e-b7a460190da0 tempest-VolumesMetadataTest-1595873547 None] Created volume successfully. Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Flow 'volume_create_manager' (c11d5a1e-8144-4071-815d-be57db114e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e208d4b4-c19b-483f-b8cc-7f1144fd71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e208d4b4-c19b-483f-b8cc-7f1144fd71a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-103691959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a952f057-bad0-429f-bb34-41412441ed11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c7cb2df5a7414188b5d3b9254a2660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:45Z,use_quota=True,user_id='a9af8eb6f595427faa4deee5cefe19bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf967a7-280c-4291-a1a3-0418404ffc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf967a7-280c-4291-a1a3-0418404ffc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ee565-6977-45b2-877b-eddc1cf04323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ee565-6977-45b2-877b-eddc1cf04323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a952f057-bad0-429f-bb34-41412441ed11', 'volume_name': 'volume-a952f057-bad0-429f-bb34-41412441ed11', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde29ba-e2a1-48a8-96a9-58a474c27273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde29ba-e2a1-48a8-96a9-58a474c27273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62663c5-bf73-44d0-bc08-287e4fa9ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Volume a952f057-bad0-429f-bb34-41412441ed11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a952f057-bad0-429f-bb34-41412441ed11', 'volume_size': 1} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-103691959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a952f057-bad0-429f-bb34-41412441ed11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c7cb2df5a7414188b5d3b9254a2660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:45Z,use_quota=True,user_id='a9af8eb6f595427faa4deee5cefe19bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Creating volume a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:45 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:45 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 1073741824 Sep 02 16:29:45 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (afbba7a4-c9e5-4a12-95ee-1feff1dc28f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450520bd-deba-47b0-a99e-18ef28a0233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450520bd-deba-47b0-a99e-18ef28a0233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1863943108',display_name='tempest-VolumesGetTest-Volume-138504640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c537a7-7ba1-49ca-b219-b2f387b02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:46Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746ba1ee-781d-4182-a992-e34535a3a439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746ba1ee-781d-4182-a992-e34535a3a439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538d8c2-d719-4b35-a608-96c81ab05853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538d8c2-d719-4b35-a608-96c81ab05853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c537a7-7ba1-49ca-b219-b2f387b02570', 'volume_name': 'volume-61c537a7-7ba1-49ca-b219-b2f387b02570', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa1b64-7222-4981-80c0-82ec9793b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa1b64-7222-4981-80c0-82ec9793b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de419af-37df-4da2-88ce-63736567feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Volume 61c537a7-7ba1-49ca-b219-b2f387b02570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c537a7-7ba1-49ca-b219-b2f387b02570', 'volume_size': 1} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 1073741824" returned: 0 in 0.703s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:45 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:29:45 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:46 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.319s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1863943108',display_name='tempest-VolumesGetTest-Volume-138504640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c537a7-7ba1-49ca-b219-b2f387b02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:46Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Creating volume 61c537a7-7ba1-49ca-b219-b2f387b02570 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:46 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:46 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 1073741824 Sep 02 16:29:46 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62663c5-bf73-44d0-bc08-287e4fa9ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a952f057-bad0-429f-bb34-41412441ed11', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84df3a-90d4-47eb-986b-25f725665c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:46 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Volume volume-a952f057-bad0-429f-bb34-41412441ed11 (a952f057-bad0-429f-bb34-41412441ed11): created successfully Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84df3a-90d4-47eb-986b-25f725665c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Flow 'volume_create_manager' (c11d5a1e-8144-4071-815d-be57db114e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6166401e-a55f-445d-a2ac-b0f2d32d5659 tempest-SnapshotDependencyTests-352509801 None] Created volume successfully. Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Acquiring lock "cinder-4d443c47-c92d-4a8e-974b-2db8b9b430b8-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "cinder-4d443c47-c92d-4a8e-974b-2db8b9b430b8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Acquiring lock "cinder-quobyte-4d443c47-c92d-4a8e-974b-2db8b9b430b8" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "cinder-quobyte-4d443c47-c92d-4a8e-974b-2db8b9b430b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b1213-e040-4656-bbff-7901356f0336]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:46 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 Sep 02 16:29:46 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:46 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 1073741824" returned: 0 in 0.600s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:46 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 Sep 02 16:29:46 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:47 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8" returned: 0 in 0.448s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:47 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8 Sep 02 16:29:47 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:47 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de419af-37df-4da2-88ce-63736567feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c537a7-7ba1-49ca-b219-b2f387b02570', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09953a2-c3c0-4447-ba5b-e327916e2462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Volume volume-61c537a7-7ba1-49ca-b219-b2f387b02570 (61c537a7-7ba1-49ca-b219-b2f387b02570): created successfully Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09953a2-c3c0-4447-ba5b-e327916e2462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (afbba7a4-c9e5-4a12-95ee-1feff1dc28f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a03b8898-a27f-4ebe-8480-875c5f684460 tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:29:47 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-4d443c47-c92d-4a8e-974b-2db8b9b430b8" returned: 0 in 0.280s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "cinder-quobyte-4d443c47-c92d-4a8e-974b-2db8b9b430b8" released by "delete_volume" :: held 0.778s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Created reservations ['b95adc7a-2c77-46f8-9ef1-5c47055bcd8b', '8b85d076-ad3c-4829-8700-e7f2013d1dea', 'cf8327c5-cc75-4167-979c-79e4129f9738', '0634d53f-394d-4cda-9bdc-86eb0eec8aee'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Creating offline snapshot 7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e of volume a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5350e05-6af9-493e-b960-326e82e8ed73]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:47 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:47 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:47 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:29:47 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:47 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Deleted volume successfully. Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e5bb61b7-493c-4153-9e45-fcf6fd7d5489 tempest-VolumesMetadataTest-1595873547 None] Lock "cinder-4d443c47-c92d-4a8e-974b-2db8b9b430b8-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:47 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.520s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:48 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e 1G Sep 02 16:29:48 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-61c537a7-7ba1-49ca-b219-b2f387b02570-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "cinder-61c537a7-7ba1-49ca-b219-b2f387b02570-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-61c537a7-7ba1-49ca-b219-b2f387b02570" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-61c537a7-7ba1-49ca-b219-b2f387b02570" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[703683ee-aca6-416f-98cc-58faf11ad760]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:48 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 Sep 02 16:29:48 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:48 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e 1G" returned: 0 in 0.569s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952f057-bad0-429f-bb34-41412441ed11 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:48 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952f057-bad0-429f-bb34-41412441ed11 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:29:48 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:48 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570" returned: 0 in 0.501s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:48 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:48 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:48 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570 Sep 02 16:29:48 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:48 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952f057-bad0-429f-bb34-41412441ed11 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:48 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e is being set with open permissions: ugo+rw Sep 02 16:29:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:49 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:29:49 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:49 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-61c537a7-7ba1-49ca-b219-b2f387b02570" returned: 0 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-61c537a7-7ba1-49ca-b219-b2f387b02570" released by "delete_volume" :: held 0.902s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:49 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.445s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Created reservations ['08282a0b-1292-4dda-91f0-472c9c1a0a49', 'e489c731-5f18-4687-9beb-c5228d240290', '9471361a-801c-432b-a2d2-c00aa7e8b174', '127d48fa-35c9-4b8e-822d-3389b2aa85fe'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:49 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:49 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:49 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.406s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:49 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info Sep 02 16:29:49 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:49 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.310s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d7cb8bfc-1ed1-47d4-8287-1914bc881b17 tempest-VolumesGetTest-2067660652 None] Lock "cinder-61c537a7-7ba1-49ca-b219-b2f387b02570-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:49 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info" returned: 0 in 0.325s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:49 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info is being set with open permissions: ugo+rw Sep 02 16:29:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:49 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info Sep 02 16:29:49 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:50 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.info" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f23bf3cb-441b-4ae9-89c0-74580b054e22 tempest-SnapshotDependencyTests-352509801 None] Create snapshot completed successfully Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "cinder-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fd4ce-d967-475c-aa94-e32a59c380d4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:50 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 Sep 02 16:29:50 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:51 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" returned: 0 in 0.438s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:51 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2 Sep 02 16:29:51 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:51 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Flow 'volume_create_manager' (da3f3ef6-dd91-4b73-99bc-cee3ff624ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce9874-f434-4a14-8738-61372a756228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" returned: 0 in 0.422s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce9874-f434-4a14-8738-61372a756228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d7b82f-05d8-460c-8999-cf182c72973f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c7cb2df5a7414188b5d3b9254a2660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:51Z,use_quota=True,user_id='a9af8eb6f595427faa4deee5cefe19bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d841025b-72dd-4d22-83e8-f16ca23318b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d841025b-72dd-4d22-83e8-f16ca23318b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f95e45-fdfe-483e-b1cc-e695000f9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f95e45-fdfe-483e-b1cc-e695000f9349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3d7b82f-05d8-460c-8999-cf182c72973f', 'volume_name': 'volume-e3d7b82f-05d8-460c-8999-cf182c72973f', 'volume_size': 1, 'snapshot_id': '7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ea3a45-47a9-43fe-9fe2-3feb212908c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ea3a45-47a9-43fe-9fe2-3feb212908c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abc6dd1-4bca-498a-a167-ca63ce992dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:51 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Volume e3d7b82f-05d8-460c-8999-cf182c72973f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3d7b82f-05d8-460c-8999-cf182c72973f', 'volume_size': 1, 'snapshot_id': '7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e'} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2" released by "delete_volume" :: held 0.975s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-e3d7b82f-05d8-460c-8999-cf182c72973f" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-e3d7b82f-05d8-460c-8999-cf182c72973f" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Creating volume e3d7b82f-05d8-460c-8999-cf182c72973f from snapshot 7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] snapshot: 7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e, volume: e3d7b82f-05d8-460c-8999-cf182c72973f, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Created reservations ['5421ac60-c305-41c0-8bec-a144e52bb65d', 'a4111993-4399-40cf-aa0c-302c5f7b2568', '0fbac8be-a5e3-41b6-aab2-e854fbbb40aa', 'a0da7a53-5c86-403c-ac9e-69127b2ac639'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccbaead-b0e9-4025-a33e-ad3b83ac3987]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:51 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:51 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:51 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:29:51 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:52 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.365s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:52 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4456bcc1-5ea9-485e-bb36-6027fbc39b94 tempest-VolumesGetTest-2067660652 None] Lock "cinder-7fe7ee9d-e91b-475a-b2f7-45ede30b56f2-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:52 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.528s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a952f057-bad0-429f-bb34-41412441ed11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231479b-dfb6-4bcd-9758-27c73ac7784e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:52 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:29:52 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:52 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.544s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:52 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f Sep 02 16:29:52 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-a3015b50-2838-4caa-a466-cb1a78b5cc31-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-a3015b50-2838-4caa-a466-cb1a78b5cc31-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-a3015b50-2838-4caa-a466-cb1a78b5cc31" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:29:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-a3015b50-2838-4caa-a466-cb1a78b5cc31" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:29:53 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3523ca5-6642-4db4-9f26-1a4347fa4818]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:53 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:53 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:53 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.697s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:53 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31 Sep 02 16:29:53 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Flow 'volume_create_manager' (b74e43f1-6ce1-45a3-8a69-7a902fd0a173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ec430-5800-4f21-adfc-afb800f4f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4ec430-5800-4f21-adfc-afb800f4f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1662986910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d492d3a8-1b7d-4f54-b323-3ca9d909a8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3484a3869b45b2b3c38ff405e0a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:54Z,use_quota=True,user_id='6bdf196053ac45a3a285d7955ceb37a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f576296-c71e-459d-862f-b88fb6c0450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f576296-c71e-459d-862f-b88fb6c0450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b6a88-aa32-402d-a01c-ac9bb1e2c44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b6a88-aa32-402d-a01c-ac9bb1e2c44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd492d3a8-1b7d-4f54-b323-3ca9d909a8e3', 'volume_name': 'volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c52725-6900-4510-ae65-2cdd53edbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c52725-6900-4510-ae65-2cdd53edbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892648b6-7b68-4f7c-8eaf-57690e0ce19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:54 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Volume d492d3a8-1b7d-4f54-b323-3ca9d909a8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3', 'volume_size': 1} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:54 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a3015b50-2838-4caa-a466-cb1a78b5cc31" returned: 0 in 0.992s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-a3015b50-2838-4caa-a466-cb1a78b5cc31" released by "delete_volume" :: held 1.814s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:54 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Created reservations ['0eecf50f-c2eb-4eaa-873d-b191482af0b6', 'c1190ed2-8bd6-4ccd-be29-27b011960952', '3e42fca2-0a04-46fd-9c7e-76e7bbbdec83', '31596665-c63c-414f-828d-7e928f8f12d9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:55 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:29:55 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:55 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.721s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:29:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:29:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-732004e8-b185-417b-a977-a3dd30b8f2e4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-a3015b50-2838-4caa-a466-cb1a78b5cc31-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (439b6410-eda7-4199-9ef3-927ba5bd2d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddc3e57-e507-4098-b2f5-c31845c5bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddc3e57-e507-4098-b2f5-c31845c5bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583554696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b435647a-fc4a-4bd6-9ade-f0673d70f0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:58Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c8397a-8bfb-404b-9b48-a62c8f9f5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c8397a-8bfb-404b-9b48-a62c8f9f5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9dfacb-e8a4-4528-9e6e-ca023bdff596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:57 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9dfacb-e8a4-4528-9e6e-ca023bdff596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b435647a-fc4a-4bd6-9ade-f0673d70f0b5', 'volume_name': 'volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b519f6-a5de-42f7-9b0d-083df7507b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b519f6-a5de-42f7-9b0d-083df7507b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4ebdb-fe43-4c54-867d-b86d0d358df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:58 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Trying to clone b435647a-fc4a-4bd6-9ade-f0673d70f0b5 from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:29:58 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f" returned: 0 in 6.065s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:29:58 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Converted 1024.00 MB image at 168.80 MB/s Sep 02 16:29:58 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f is being set with open permissions: ugo+rw Sep 02 16:29:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:58 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f Sep 02 16:29:58 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:29:59 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Image download 20.69 MB at 20.69 MB/s Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c258e8f-56ae-4090-88d6-9c44e3242f08]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:59 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" released by "_copy_volume_from_snapshot" :: held 7.801s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-e3d7b82f-05d8-460c-8999-cf182c72973f" released by "_create_volume_from_snapshot" :: held 7.908s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.939s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.848s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1662986910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d492d3a8-1b7d-4f54-b323-3ca9d909a8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3484a3869b45b2b3c38ff405e0a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:54Z,use_quota=True,user_id='6bdf196053ac45a3a285d7955ceb37a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Creating volume d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:29:59 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:29:59 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD Sep 02 16:29:59 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:59 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 1073741824 Sep 02 16:29:59 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abc6dd1-4bca-498a-a167-ca63ce992dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d7b82f-05d8-460c-8999-cf182c72973f', 'volume_size': 1, 'snapshot_id': '7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cda79a4-bc90-4f91-9cb5-8b430c6d4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:29:59 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Volume volume-e3d7b82f-05d8-460c-8999-cf182c72973f (e3d7b82f-05d8-460c-8999-cf182c72973f): created successfully Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cda79a4-bc90-4f91-9cb5-8b430c6d4865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Flow 'volume_create_manager' (da3f3ef6-dd91-4b73-99bc-cee3ff624ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:29:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2dc18023-078f-4ff1-b03a-2c612ea0de13 tempest-SnapshotDependencyTests-352509801 None] Created volume successfully. Sep 02 16:29:59 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd is fetched for user 5c96420189384c70813633d5d20a2f7a. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b589198-6e8b-4fff-9689-7e5d740ec4bd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:29:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:00 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD Sep 02 16:30:00 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:00 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 1073741824" returned: 0 in 0.618s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:00 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 Sep 02 16:30:00 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:00 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:00 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583554696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b435647a-fc4a-4bd6-9ade-f0673d70f0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:29:58Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Creating volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:00 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892648b6-7b68-4f7c-8eaf-57690e0ce19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0d49a5-6dac-429b-8f6f-6eaf1a78783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:00 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1073741824 Sep 02 16:30:00 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Volume volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 (d492d3a8-1b7d-4f54-b323-3ca9d909a8e3): created successfully Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0d49a5-6dac-429b-8f6f-6eaf1a78783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Flow 'volume_create_manager' (b74e43f1-6ce1-45a3-8a69-7a902fd0a173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e5bcaf35-38de-4349-8369-2ccd1798ce51 tempest-VolumesTransfersTest-54241421 None] Created volume successfully. Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Deleting offline snapshot 7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e of volume a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] snapshot_file for this snap is: volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a846b878-2900-40a5-82e3-2cc4b5703678]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:00 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:30:00 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:00 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1073741824" returned: 0 in 0.545s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:01 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 Sep 02 16:30:01 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:01 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.476s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a952f057-bad0-429f-bb34-41412441ed11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b4b87-f0de-4a4d-8078-19653f8645a7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:01 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:30:01 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:01 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" returned: 0 in 0.352s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Attempting download of e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02f001-3f64-4c80-af60-641d4d7169ef]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:01 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s Sep 02 16:30:01 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:01 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.711s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:01 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:30:01 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:01 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s" returned: 0 in 0.440s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:02 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s Sep 02 16:30:02 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a4a1472d-d0f3-4284-b473-772241f01357 tempest-VolumesTransfersTest-919689231 None] Transfer volume completed successfully. Sep 02 16:30:02 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.479s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:02 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s" returned: 1 in 0.441s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_j2iw2w8s' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10572430-e256-4c95-951a-9e134280ec6b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:02 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e Sep 02 16:30:02 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:02 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD Sep 02 16:30:02 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:02 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11.7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" returned: 0 in 0.344s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e" released by "_delete_snapshot" :: held 2.180s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" released by "delete_snapshot" :: held 2.207s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:02 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:02 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 Sep 02 16:30:02 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Created reservations ['3e2f316d-7c59-4713-bd68-f45f519ecff7', 'efe317a9-78db-4e55-8fc3-7b7f59a8e652', 'b28e5531-1651-40a8-a402-7a49c68c10a8', '3e40cd09-9a5a-4e62-b211-5968928b0401'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "cinder-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Delete snapshot completed successfully. Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "cinder-quobyte-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-035e38f6-9d47-4e1a-89e8-c10e7e6d9622 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-7a9d3aa3-e6d7-4fc2-ac01-323c9c55673e-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-quobyte-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ad563-ef0f-462c-b89a-1f3ce424612d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:03 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 Sep 02 16:30:03 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:03 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" returned: 0 in 0.401s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:03 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3 Sep 02 16:30:03 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:03 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-a952f057-bad0-429f-bb34-41412441ed11-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-quobyte-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3" released by "delete_volume" :: held 0.760s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-a952f057-bad0-429f-bb34-41412441ed11-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Created reservations ['3024b958-bf18-435f-8620-6822f9fe083a', 'e5093d7d-a48a-4c88-882e-837c0938e7ac', '72b5ba7e-81c9-4ac1-98cc-19dd99872b04', 'e29aaa1e-f959-4483-92b2-db307de255de'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a9ef8f-1833-4481-92d3-9260dbfae6ed]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:04 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:04 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:04 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:30:04 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:04 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.348s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Deleted volume successfully. Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5b8b2390-2f29-41ff-8ae7-a52c1ed692c2 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-d492d3a8-1b7d-4f54-b323-3ca9d909a8e3-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:04 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.652s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:04 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11 Sep 02 16:30:04 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:04 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Flow 'volume_create_manager' (6a068395-dc13-496f-bd5b-53deaee9f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17618e5-491e-442e-9c6b-fe9ac7d3a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a952f057-bad0-429f-bb34-41412441ed11" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17618e5-491e-442e-9c6b-fe9ac7d3a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-797015229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ab52f-7c0a-44b9-a4d1-696504b07d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3484a3869b45b2b3c38ff405e0a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:05Z,use_quota=True,user_id='6bdf196053ac45a3a285d7955ceb37a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aac6d6-0dd3-47db-a00a-c00422e4b53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aac6d6-0dd3-47db-a00a-c00422e4b53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9d45b4-42d7-4834-a363-4f0512ca4226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9d45b4-42d7-4834-a363-4f0512ca4226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34ab52f-7c0a-44b9-a4d1-696504b07d5c', 'volume_name': 'volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f689876d-d4b2-4b88-82fe-b3ca36687d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f689876d-d4b2-4b88-82fe-b3ca36687d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e359022-1d6f-405c-b17d-29452209fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Volume b34ab52f-7c0a-44b9-a4d1-696504b07d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c', 'volume_size': 1} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-797015229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ab52f-7c0a-44b9-a4d1-696504b07d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3484a3869b45b2b3c38ff405e0a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:05Z,use_quota=True,user_id='6bdf196053ac45a3a285d7955ceb37a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Creating volume b34ab52f-7c0a-44b9-a4d1-696504b07d5c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-a952f057-bad0-429f-bb34-41412441ed11" released by "delete_volume" :: held 1.195s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" returned: 0 in 2.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_74_22qxndevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Converted 112.00 MB image at 48.65 MB/s Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:05 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c 1073741824 Sep 02 16:30:05 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:05 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1G Sep 02 16:30:05 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Created reservations ['379fd3da-90b7-422f-a430-50a4861221bc', '69d234c6-7436-4ee3-a97d-d54b9565b185', '961738e0-5775-4e5b-aaa7-ef81ebad2a62', '143fab8e-eb6b-478c-a0aa-716b1cbc3ddd'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:05 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:05 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:05 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 1G" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Downloaded image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd for user 5c96420189384c70813633d5d20a2f7a is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Marking volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Copying metadata from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd to b435647a-fc4a-4bd6-9ade-f0673d70f0b5. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Creating volume glance metadata for volume b435647a-fc4a-4bd6-9ade-f0673d70f0b5 backed by image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:30:05 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Deleted volume successfully. Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1161a681-a7d9-4d92-abdf-0a8b7059d9f0 tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-a952f057-bad0-429f-bb34-41412441ed11-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:05 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c 1073741824" returned: 0 in 0.541s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4ebdb-fe43-4c54-867d-b86d0d358df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69192e8-478c-4f0b-85df-a83c1bb8458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Volume volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 (b435647a-fc4a-4bd6-9ade-f0673d70f0b5): created successfully Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69192e8-478c-4f0b-85df-a83c1bb8458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:05 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (439b6410-eda7-4199-9ef3-927ba5bd2d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:05 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3b4e8fd5-a136-4d98-9713-e4f04ea3c27d tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:30:05 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" returned: 0 in 0.317s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e359022-1d6f-405c-b17d-29452209fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b07fe-c489-482c-950a-72764bbf821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Volume volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c (b34ab52f-7c0a-44b9-a4d1-696504b07d5c): created successfully Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b07fe-c489-482c-950a-72764bbf821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Flow 'volume_create_manager' (6a068395-dc13-496f-bd5b-53deaee9f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bef52f75-043a-406b-9aab-309f3f3dbad1 tempest-VolumesTransfersTest-54241421 None] Created volume successfully. Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-e3d7b82f-05d8-460c-8999-cf182c72973f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-e3d7b82f-05d8-460c-8999-cf182c72973f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0448e9-666b-4651-ada6-70ccfcd5b055]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:06 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f Sep 02 16:30:06 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:06 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:06 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f Sep 02 16:30:06 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:06 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e3d7b82f-05d8-460c-8999-cf182c72973f" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:06 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (bd270840-eae0-4971-8658-979357825847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5440c58-64eb-4444-866d-5ba10e9fe2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5440c58-64eb-4444-866d-5ba10e9fe2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45295472',display_name='tempest-VolumesGetTest-Volume-965353308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef49f75d-1b25-4a5a-abdb-63884f6cbc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:07Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c867f7f1-eb56-4449-8357-dc55a8dc5bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c867f7f1-eb56-4449-8357-dc55a8dc5bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86651725-36ac-4eb2-bdae-6a1d158fada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86651725-36ac-4eb2-bdae-6a1d158fada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef49f75d-1b25-4a5a-abdb-63884f6cbc3f', 'volume_name': 'volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89ea3a3-5ea8-4293-a9ed-94814e139685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89ea3a3-5ea8-4293-a9ed-94814e139685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623cb47-a614-474c-9d8d-6ac6a9de01c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Volume ef49f75d-1b25-4a5a-abdb-63884f6cbc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f', 'volume_size': 1} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45295472',display_name='tempest-VolumesGetTest-Volume-965353308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef49f75d-1b25-4a5a-abdb-63884f6cbc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fbff3b950742e1aa2324a832f78940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:07Z,use_quota=True,user_id='5c96420189384c70813633d5d20a2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Creating volume ef49f75d-1b25-4a5a-abdb-63884f6cbc3f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:07 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-quobyte-e3d7b82f-05d8-460c-8999-cf182c72973f" released by "delete_volume" :: held 0.904s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:07 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f 1073741824 Sep 02 16:30:07 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Created reservations ['8a3e6cba-1d7b-46e6-a1ba-163a9693b256', '404cd8bd-dd00-41d4-96bc-49d5b371d1a6', '82247e4c-bd30-424b-9dd2-6fcf551116c8', 'dabec084-8050-4bfb-8a6e-9bdcb03ee878'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:07 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:07 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "cinder-b34ab52f-7c0a-44b9-a4d1-696504b07d5c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-b34ab52f-7c0a-44b9-a4d1-696504b07d5c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "cinder-quobyte-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-quobyte-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a7d82-b7cd-4472-bb8c-cbec10f06ec6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:07 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c Sep 02 16:30:07 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:07 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.574s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Deleted volume successfully. Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e28507f5-c23d-436c-8eda-4684403bcf9e tempest-SnapshotDependencyTests-352509801 None] Lock "cinder-e3d7b82f-05d8-460c-8999-cf182c72973f-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:07 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f 1073741824" returned: 0 in 0.894s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:08 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f Sep 02 16:30:08 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:08 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" returned: 0 in 0.540s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:08 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c Sep 02 16:30:08 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:08 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623cb47-a614-474c-9d8d-6ac6a9de01c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cd4f30-790a-466d-b8d5-9bd09f5b80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:08 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Volume volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f (ef49f75d-1b25-4a5a-abdb-63884f6cbc3f): created successfully Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cd4f30-790a-466d-b8d5-9bd09f5b80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Flow 'volume_create_manager' (bd270840-eae0-4971-8658-979357825847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-46bc9860-eff9-4064-b576-3503c6a0fb08 tempest-VolumesGetTest-2067660652 None] Created volume successfully. Sep 02 16:30:08 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" returned: 0 in 0.339s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-quobyte-b34ab52f-7c0a-44b9-a4d1-696504b07d5c" released by "delete_volume" :: held 0.939s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Created reservations ['e1c795a3-9f98-4fd9-bab3-fe469650cce3', 'd5cf5495-0ad5-4166-a99f-1cf546d49148', '73bf2af8-f605-49fe-8288-719738b13046', 'f53a4a44-043e-45f6-9378-302765b926e1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:08 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:08 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:09 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Deleted volume successfully. Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c5228bc0-fbf0-48dd-9378-915c41ff0459 tempest-VolumesTransfersTest-1586525025 None] Lock "cinder-b34ab52f-7c0a-44b9-a4d1-696504b07d5c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe1144-7783-461d-ab6b-c0382fba50a4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:09 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f Sep 02 16:30:09 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:10 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" returned: 0 in 0.427s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:10 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f Sep 02 16:30:10 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:10 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" returned: 0 in 0.311s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f" released by "delete_volume" :: held 0.792s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Created reservations ['9925dab0-4080-4afb-a617-1d73911aab20', 'a3cbebf3-43e6-40b4-abf4-6cede470eab5', '75feaa49-41b9-4ac9-aa3a-d0fec2dd4f46', 'b4d22ff1-ce7b-4621-9a68-961b80bd7dce'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:10 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:10 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-b435647a-fc4a-4bd6-9ade-f0673d70f0b5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:10 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "cinder-b435647a-fc4a-4bd6-9ade-f0673d70f0b5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.335s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:10 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-83e6689a-bd54-4f9b-8d7d-a780154c75b4 tempest-VolumesGetTest-2067660652 None] Lock "cinder-ef49f75d-1b25-4a5a-abdb-63884f6cbc3f-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Acquiring lock "cinder-quobyte-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24d958d-4773-4223-bc1f-48834fe4570b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:11 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 Sep 02 16:30:11 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:11 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:11 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5 Sep 02 16:30:11 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:11 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "cinder-quobyte-b435647a-fc4a-4bd6-9ade-f0673d70f0b5" released by "delete_volume" :: held 0.715s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Created reservations ['a6b6e115-5f48-4e17-970d-050a93110308', '9c44a86c-376c-4e3b-9d9c-d37a55ce6176', '09af6f0b-9228-4149-bca7-6413850c2097', 'f9097c5d-7bb1-4425-acd0-d6ae8809e172'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:11 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:11 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:12 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:12 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Deleted volume successfully. Sep 02 16:30:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a8cc6859-7638-49f1-af2a-373e8e8aa2ac tempest-VolumesGetTest-2067660652 None] Lock "cinder-b435647a-fc4a-4bd6-9ade-f0673d70f0b5-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Flow 'volume_create_manager' (5f29c435-66b3-465c-be97-cb71fe2dd379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a14b00-415f-44a6-b896-a7373118bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a14b00-415f-44a6-b896-a7373118bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1120170024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04df9484-4d6b-4093-b5ba-a002344eea66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0261d0435a34498abbec18884a476c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:15Z,use_quota=True,user_id='984ac322c93946cf925aab5cea3516c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64170549-ad6f-4945-b126-e3baf504ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64170549-ad6f-4945-b126-e3baf504ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce2883d-804e-41b3-a7f0-53d34b4e488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce2883d-804e-41b3-a7f0-53d34b4e488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04df9484-4d6b-4093-b5ba-a002344eea66', 'volume_name': 'volume-04df9484-4d6b-4093-b5ba-a002344eea66', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c190ebf-7987-4dfd-8d9d-d98317335466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c190ebf-7987-4dfd-8d9d-d98317335466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e91da5-68de-45f4-845c-ad1a9059dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume 04df9484-4d6b-4093-b5ba-a002344eea66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04df9484-4d6b-4093-b5ba-a002344eea66', 'volume_size': 1} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1120170024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04df9484-4d6b-4093-b5ba-a002344eea66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0261d0435a34498abbec18884a476c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:15Z,use_quota=True,user_id='984ac322c93946cf925aab5cea3516c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Creating volume 04df9484-4d6b-4093-b5ba-a002344eea66 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:15 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:15 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 1073741824 Sep 02 16:30:15 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Flow 'volume_create_manager' (e51735ac-baa6-443f-9fea-6a082cb99882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9916e-d991-4b9e-a81d-1dc6f90db134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9916e-d991-4b9e-a81d-1dc6f90db134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928478971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0261d0435a34498abbec18884a476c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:16Z,use_quota=True,user_id='984ac322c93946cf925aab5cea3516c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedc32e2-1318-4fe3-9a87-d497f012e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedc32e2-1318-4fe3-9a87-d497f012e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a3835e-9577-4d74-8a44-027708c7f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a3835e-9577-4d74-8a44-027708c7f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb', 'volume_name': 'volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce49a16e-6ce3-4b01-bf74-58914396ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce49a16e-6ce3-4b01-bf74-58914396ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde80483-c21d-49ef-8ded-8fe70a1756d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume 69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb', 'volume_size': 1} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:16 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 1073741824" returned: 0 in 0.822s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:16 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 Sep 02 16:30:16 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:16 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66" returned: 0 in 0.404s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928478971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0261d0435a34498abbec18884a476c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:16Z,use_quota=True,user_id='984ac322c93946cf925aab5cea3516c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Creating volume 69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e91da5-68de-45f4-845c-ad1a9059dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04df9484-4d6b-4093-b5ba-a002344eea66', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:16 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb 1073741824 Sep 02 16:30:16 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caeb02d-e0d5-4fdc-8737-68a7afbc6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume volume-04df9484-4d6b-4093-b5ba-a002344eea66 (04df9484-4d6b-4093-b5ba-a002344eea66): created successfully Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caeb02d-e0d5-4fdc-8737-68a7afbc6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Flow 'volume_create_manager' (5f29c435-66b3-465c-be97-cb71fe2dd379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b7618229-bb08-4c6d-b5dd-b5124b0b00d4 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Created volume successfully. Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:17 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Flow 'volume_create_manager' (2f8a77f0-8315-4c24-ab30-386bf100a572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2f269-63e8-4ed3-a93f-cc78ef341b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb 1073741824" returned: 0 in 0.713s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2f269-63e8-4ed3-a93f-cc78ef341b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1963513140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdaa02-6899-4371-9752-1bc028e6a7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6aa6398ca1428d93c9da46796cd6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:17Z,use_quota=True,user_id='d01d542743384a22b7cde2105a9748cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa5dd65-b35b-47be-b31e-f35f1b968340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa5dd65-b35b-47be-b31e-f35f1b968340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73a0ec4-4639-4739-acc2-aa4a6760adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73a0ec4-4639-4739-acc2-aa4a6760adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffdaa02-6899-4371-9752-1bc028e6a7a5', 'volume_name': 'volume-cffdaa02-6899-4371-9752-1bc028e6a7a5', 'volume_size': 2}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68d5344-45e4-434f-9e9a-22ac50af3e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68d5344-45e4-434f-9e9a-22ac50af3e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efefdec-04fd-4f4e-8986-e0dd1431a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Volume cffdaa02-6899-4371-9752-1bc028e6a7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffdaa02-6899-4371-9752-1bc028e6a7a5', 'volume_size': 2} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:17 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb Sep 02 16:30:17 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:17 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1963513140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdaa02-6899-4371-9752-1bc028e6a7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6aa6398ca1428d93c9da46796cd6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:17Z,use_quota=True,user_id='d01d542743384a22b7cde2105a9748cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Creating volume cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 2147483648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:17 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 2147483648 Sep 02 16:30:17 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde80483-c21d-49ef-8ded-8fe70a1756d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345daea9-ec42-4db9-94c1-b8808bad9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Volume volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb (69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb): created successfully Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345daea9-ec42-4db9-94c1-b8808bad9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Flow 'volume_create_manager' (e51735ac-baa6-443f-9fea-6a082cb99882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c9fc4c2c-5d7c-47b7-81e1-195ad6ab2cc6 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Created volume successfully. Sep 02 16:30:18 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 2147483648" returned: 0 in 0.742s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:18 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 Sep 02 16:30:18 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:18 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efefdec-04fd-4f4e-8986-e0dd1431a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffdaa02-6899-4371-9752-1bc028e6a7a5', 'volume_size': 2}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b66481-4e26-44b7-86f4-6530cddfb9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Volume volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 (cffdaa02-6899-4371-9752-1bc028e6a7a5): created successfully Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b66481-4e26-44b7-86f4-6530cddfb9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Flow 'volume_create_manager' (2f8a77f0-8315-4c24-ab30-386bf100a572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2ef98a95-0e91-428a-a898-924a1f5ad296 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Created volume successfully. Sep 02 16:30:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Creating offline snapshot 3b433ee7-527e-4649-af36-e89a9e185c4d of volume cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:30:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557d45d-b04e-418a-bd47-00f437ac2713]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:19 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 Sep 02 16:30:19 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:20 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5" returned: 0 in 0.476s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d 2G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:20 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d 2G Sep 02 16:30:20 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:20 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d 2G" returned: 0 in 0.576s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:20 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d Sep 02 16:30:20 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:21 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d" returned: 0 in 0.413s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:21 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d is being set with open permissions: ugo+rw Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:21 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d Sep 02 16:30:21 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:21 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d" returned: 0 in 0.296s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:21 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info Sep 02 16:30:21 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:21 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info" returned: 0 in 0.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:21 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info is being set with open permissions: ugo+rw Sep 02 16:30:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:21 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info Sep 02 16:30:21 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:22 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.info" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8bb17592-66ba-4bd8-bfc7-e8f9d0c566e1 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Create snapshot completed successfully Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "cinder-3b433ee7-527e-4649-af36-e89a9e185c4d-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-3b433ee7-527e-4649-af36-e89a9e185c4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "cinder-quobyte-3b433ee7-527e-4649-af36-e89a9e185c4d" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-3b433ee7-527e-4649-af36-e89a9e185c4d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Deleting offline snapshot 3b433ee7-527e-4649-af36-e89a9e185c4d of volume cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] snapshot_file for this snap is: volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d83952-41aa-4159-958f-eb82ca632d5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:23 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d Sep 02 16:30:23 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:23 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d" returned: 0 in 0.660s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffdaa02-6899-4371-9752-1bc028e6a7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:30:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478c70e-bd24-41c8-96c7-d8223c11082f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:23 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 Sep 02 16:30:23 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:24 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5" returned: 0 in 0.493s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:24 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d Sep 02 16:30:24 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:24 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:24 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d Sep 02 16:30:24 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:24 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5.3b433ee7-527e-4649-af36-e89a9e185c4d" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-3b433ee7-527e-4649-af36-e89a9e185c4d" released by "_delete_snapshot" :: held 2.095s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" released by "delete_snapshot" :: held 2.127s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:25 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Created reservations ['0558f239-f62a-4525-b7c4-38ca3e0ca0d1', 'c0ce2ef2-efdd-4e2b-ba26-dac2e76278c7', 'e11c0fd2-5cec-4a7c-a4ac-a4adb698f8df', 'ea41bb1d-8ad7-43b6-a3be-eb4def8eaf49'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Delete snapshot completed successfully. Sep 02 16:30:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9114d71b-6f62-4428-9a0e-1a360230852c tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-3b433ee7-527e-4649-af36-e89a9e185c4d-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "cinder-cffdaa02-6899-4371-9752-1bc028e6a7a5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-cffdaa02-6899-4371-9752-1bc028e6a7a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d099ec2-ad1a-41d4-a4cf-91b062cbc716]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:26 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 Sep 02 16:30:26 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:26 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5" returned: 0 in 0.424s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:26 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5 Sep 02 16:30:26 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:27 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-cffdaa02-6899-4371-9752-1bc028e6a7a5" returned: 0 in 0.360s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-quobyte-cffdaa02-6899-4371-9752-1bc028e6a7a5" released by "delete_volume" :: held 0.858s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Created reservations ['8da777f1-0d24-401e-aa25-706dd4c32e2a', 'e216d3b7-2574-4edb-942a-ddbc93b9f25f', '1e2dcc22-5d68-4e29-8135-63d5f184e3a9', '23ce8319-5adb-4b41-b88f-2a888f2170b7'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:27 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:27 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:27 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Deleted volume successfully. Sep 02 16:30:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1fa0203d-dbec-4901-af5b-7f3585f17457 tempest-VolumesSnapshotNegativeTestJSON-492090030 None] Lock "cinder-cffdaa02-6899-4371-9752-1bc028e6a7a5-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:31 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (c918bd79-824f-4a51-ba63-9283a135a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f61bd-a8f0-47fb-b3ec-3e825ae55790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f61bd-a8f0-47fb-b3ec-3e825ae55790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853201429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d555c029-5bca-466e-a364-4941818e015d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:32Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f975a51d-c3dc-49a6-b624-dd6c6bca119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f975a51d-c3dc-49a6-b624-dd6c6bca119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf23373-9bb9-4d3d-951d-6eec321f0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf23373-9bb9-4d3d-951d-6eec321f0e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd555c029-5bca-466e-a364-4941818e015d', 'volume_name': 'volume-d555c029-5bca-466e-a364-4941818e015d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d968834-35a9-4451-af14-d6456fef18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d968834-35a9-4451-af14-d6456fef18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01abc2b0-92df-4491-afd6-53d4516c364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:32 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Volume d555c029-5bca-466e-a364-4941818e015d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d555c029-5bca-466e-a364-4941818e015d', 'volume_size': 1} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853201429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d555c029-5bca-466e-a364-4941818e015d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:32Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Creating volume d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:32 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:32 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d 1073741824 Sep 02 16:30:32 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:32 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d 1073741824" returned: 0 in 0.740s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:33 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d Sep 02 16:30:33 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:33 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01abc2b0-92df-4491-afd6-53d4516c364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d555c029-5bca-466e-a364-4941818e015d', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818b5dbd-4861-4c3f-b15f-9819be793129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:33 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Volume volume-d555c029-5bca-466e-a364-4941818e015d (d555c029-5bca-466e-a364-4941818e015d): created successfully Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818b5dbd-4861-4c3f-b15f-9819be793129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (c918bd79-824f-4a51-ba63-9283a135a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7c38cd6b-802a-48e8-ad4e-e59cdb695e97 tempest-VolumesSnapshotTestJSON-256307722 None] Created volume successfully. Sep 02 16:30:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Creating offline snapshot c72d4f20-0f92-4ea9-bd4c-eca21492d06d of volume d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:30:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e4f31e-f50c-4f7f-a0c0-835747d70816]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:34 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d Sep 02 16:30:34 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:35 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d" returned: 0 in 0.610s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:35 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d 1G Sep 02 16:30:35 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:35 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d 1G" returned: 0 in 0.598s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d555c029-5bca-466e-a364-4941818e015d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:35 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d555c029-5bca-466e-a364-4941818e015d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d Sep 02 16:30:35 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:36 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d555c029-5bca-466e-a364-4941818e015d -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:36 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d is being set with open permissions: ugo+rw Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:36 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d Sep 02 16:30:36 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:36 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d" returned: 0 in 0.317s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:36 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info Sep 02 16:30:36 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:36 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:36 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info is being set with open permissions: ugo+rw Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:36 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info Sep 02 16:30:36 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:36 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.info" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c2e175b7-c711-4801-83e4-70828357ac9e tempest-VolumesSnapshotTestJSON-256307722 None] Create snapshot completed successfully Sep 02 16:30:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-c72d4f20-0f92-4ea9-bd4c-eca21492d06d-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-c72d4f20-0f92-4ea9-bd4c-eca21492d06d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-c72d4f20-0f92-4ea9-bd4c-eca21492d06d" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c72d4f20-0f92-4ea9-bd4c-eca21492d06d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Deleting offline snapshot c72d4f20-0f92-4ea9-bd4c-eca21492d06d of volume d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] snapshot_file for this snap is: volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18dd530-dc76-445a-af29-ad8e3dd2c997]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:38 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d Sep 02 16:30:38 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:38 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d" returned: 0 in 0.436s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d555c029-5bca-466e-a364-4941818e015d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b6469e-7f04-4e53-afb8-a8cb13aaff39]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:38 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d Sep 02 16:30:38 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:39 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d" returned: 0 in 0.695s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:39 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d Sep 02 16:30:39 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:39 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d" returned: 0 in 0.524s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:39 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d Sep 02 16:30:39 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:40 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d.c72d4f20-0f92-4ea9-bd4c-eca21492d06d" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c72d4f20-0f92-4ea9-bd4c-eca21492d06d" released by "_delete_snapshot" :: held 2.132s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" released by "delete_snapshot" :: held 2.181s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:40 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['d2dfba9a-9166-4eda-ac39-7757a8a3ab87', '0bcf6fa7-b6fa-4b96-ac11-d6dc11fa53b1', '58359949-5246-4242-ae1e-e00b39827060', '28ba0275-9516-4c73-bd5a-eceae40b41b6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Delete snapshot completed successfully. Sep 02 16:30:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f461e11e-228c-40a2-9f20-1625f1760eb6 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-c72d4f20-0f92-4ea9-bd4c-eca21492d06d-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=151,cinder:SELECT=117,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (e5c95f48-959a-4d65-8332-efefb4442dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18303738-8968-431a-9476-539fe73fa15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18303738-8968-431a-9476-539fe73fa15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-425068955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e54d20-8b42-4640-8270-93a02bdfc317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:42Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0961f602-ba70-48cc-b5b3-b3f67d5380f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0961f602-ba70-48cc-b5b3-b3f67d5380f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5d137f-75d3-4fc6-93e2-328a9cf21ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5d137f-75d3-4fc6-93e2-328a9cf21ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e54d20-8b42-4640-8270-93a02bdfc317', 'volume_name': 'volume-23e54d20-8b42-4640-8270-93a02bdfc317', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04acf9d9-f2aa-44b1-b708-70097d6e2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04acf9d9-f2aa-44b1-b708-70097d6e2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538e5c9d-4dc2-4bd7-a4a8-637a9f0337f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Volume 23e54d20-8b42-4640-8270-93a02bdfc317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e54d20-8b42-4640-8270-93a02bdfc317', 'volume_size': 1} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-425068955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e54d20-8b42-4640-8270-93a02bdfc317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:42Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Creating volume 23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:42 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:42 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 1073741824 Sep 02 16:30:42 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:42 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 1073741824" returned: 0 in 0.479s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:42 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:42 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:42 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:30:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538e5c9d-4dc2-4bd7-a4a8-637a9f0337f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e54d20-8b42-4640-8270-93a02bdfc317', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60b9948-821b-4d20-a18d-e71838dd938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:43 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Volume volume-23e54d20-8b42-4640-8270-93a02bdfc317 (23e54d20-8b42-4640-8270-93a02bdfc317): created successfully Sep 02 16:30:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60b9948-821b-4d20-a18d-e71838dd938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (e5c95f48-959a-4d65-8332-efefb4442dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:43 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-19c81077-c010-4970-ab3f-06d32bc842dd tempest-VolumesSnapshotTestJSON-256307722 None] Created volume successfully. Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=152,cinder:DELETE=15,cinder:INSERT=45,cinder:SELECT=130 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Creating offline snapshot 73c4fa9d-d341-49e9-b057-c2a5dbbaa580 of volume 23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e17ba-09d1-46fb-87dd-abc55c06570e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:44 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:44 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:44 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:44 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 1G Sep 02 16:30:44 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:45 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 1G" returned: 0 in 0.429s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e54d20-8b42-4640-8270-93a02bdfc317 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:45 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e54d20-8b42-4640-8270-93a02bdfc317 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:45 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:45 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e54d20-8b42-4640-8270-93a02bdfc317 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:45 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 is being set with open permissions: ugo+rw Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:45 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:45 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:45 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:45 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info Sep 02 16:30:45 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:46 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info" returned: 0 in 0.268s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:46 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info is being set with open permissions: ugo+rw Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:46 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info Sep 02 16:30:46 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:46 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.info" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-00f23452-3302-496c-a91a-e96c3ebcd594 tempest-VolumesSnapshotTestJSON-256307722 None] Create snapshot completed successfully Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (e21b79f0-62aa-4798-8d00-feacbd436853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52a8d85-79dd-4623-8180-35abbfa9e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52a8d85-79dd-4623-8180-35abbfa9e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583887439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154b1615-8c65-4022-914c-af3004c89109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:30:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=73c4fa9d-d341-49e9-b057-c2a5dbbaa580,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:30:47Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e35d37-fa3f-41c6-be1b-35b8dbcdd191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e35d37-fa3f-41c6-be1b-35b8dbcdd191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae843946-5de3-418d-89aa-97576886061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae843946-5de3-418d-89aa-97576886061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '154b1615-8c65-4022-914c-af3004c89109', 'volume_name': 'volume-154b1615-8c65-4022-914c-af3004c89109', 'volume_size': 2, 'snapshot_id': '73c4fa9d-d341-49e9-b057-c2a5dbbaa580'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f25441-bf65-4e0b-a60a-02cd6ba7a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f25441-bf65-4e0b-a60a-02cd6ba7a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12539635-d018-416f-8033-c310c82dd210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Volume 154b1615-8c65-4022-914c-af3004c89109: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-154b1615-8c65-4022-914c-af3004c89109', 'volume_size': 2, 'snapshot_id': '73c4fa9d-d341-49e9-b057-c2a5dbbaa580'} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-154b1615-8c65-4022-914c-af3004c89109" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-154b1615-8c65-4022-914c-af3004c89109" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Creating volume 154b1615-8c65-4022-914c-af3004c89109 from snapshot 73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] snapshot: 73c4fa9d-d341-49e9-b057-c2a5dbbaa580, volume: 154b1615-8c65-4022-914c-af3004c89109, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[386653c9-60a7-4a6d-aecf-ab32990677ad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:47 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:47 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:47 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.375s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e54d20-8b42-4640-8270-93a02bdfc317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b086e7-35db-4074-abc7-ea83df0ded29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:47 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:47 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:47 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.403s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:30:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:47 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 Sep 02 16:30:47 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:48 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:48 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:49 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.717s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:30:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:30:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:30:53 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109" returned: 0 in 5.327s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:30:53 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Converted 1024.00 MB image at 192.18 MB/s Sep 02 16:30:53 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 is being set with open permissions: ugo+rw Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:53 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 Sep 02 16:30:53 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:53 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" released by "_copy_volume_from_snapshot" :: held 6.437s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-154b1615-8c65-4022-914c-af3004c89109" released by "_create_volume_from_snapshot" :: held 6.516s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.534s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12539635-d018-416f-8033-c310c82dd210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154b1615-8c65-4022-914c-af3004c89109', 'volume_size': 2, 'snapshot_id': '73c4fa9d-d341-49e9-b057-c2a5dbbaa580'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db03ca15-e4dc-4dc8-986e-044e15a6e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:30:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Volume volume-154b1615-8c65-4022-914c-af3004c89109 (154b1615-8c65-4022-914c-af3004c89109): created successfully Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db03ca15-e4dc-4dc8-986e-044e15a6e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (e21b79f0-62aa-4798-8d00-feacbd436853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:30:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e0eac36b-9c2e-4b10-a45a-0a061a1ccbc3 tempest-VolumesSnapshotTestJSON-256307722 None] Created volume successfully. Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-154b1615-8c65-4022-914c-af3004c89109-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-154b1615-8c65-4022-914c-af3004c89109-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1634256a-44e1-4979-bfd3-c1a0bcf29679]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:54 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 Sep 02 16:30:54 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:54 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109" returned: 0 in 0.403s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:54 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109 Sep 02 16:30:54 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:54 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-154b1615-8c65-4022-914c-af3004c89109" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-154b1615-8c65-4022-914c-af3004c89109" released by "delete_volume" :: held 0.718s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['70958771-6606-4f42-91e5-6ba02b3a24f8', '15782bc5-1236-43bf-be8a-d004d6f58bde', 'e4496e56-7f84-41cc-84dc-d50cd6fec3b7', '8580479d-ce24-4245-ba8a-3a62c2897c06'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:54 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:54 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:55 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Deleted volume successfully. Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bb94e825-b6f7-4c9a-9bb4-c837c0561332 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-154b1615-8c65-4022-914c-af3004c89109-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Deleting offline snapshot 73c4fa9d-d341-49e9-b057-c2a5dbbaa580 of volume 23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] snapshot_file for this snap is: volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe34ce6-68ca-43fc-9a17-c23b771b276a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:55 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:55 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:55 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.420s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e54d20-8b42-4640-8270-93a02bdfc317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86bfeed-2127-4991-a1df-13896056ec29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:55 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:55 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:56 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.593s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:56 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:56 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-b20ebf24-6511-4f0c-bbb0-c759e6e59c17 req-ad35b4aa-2cf9-4793-baf2-d24c447962a1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-b20ebf24-6511-4f0c-bbb0-c759e6e59c17 req-ad35b4aa-2cf9-4793-baf2-d24c447962a1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-b20ebf24-6511-4f0c-bbb0-c759e6e59c17 req-ad35b4aa-2cf9-4793-baf2-d24c447962a1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-b20ebf24-6511-4f0c-bbb0-c759e6e59c17 req-ad35b4aa-2cf9-4793-baf2-d24c447962a1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-04df9484-4d6b-4093-b5ba-a002344eea66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83e61ddd-3724-4573-be95-9c25cab603e1', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:30:56 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.457s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-b20ebf24-6511-4f0c-bbb0-c759e6e59c17 req-ad35b4aa-2cf9-4793-baf2-d24c447962a1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] attachment_update completed successfully. Sep 02 16:30:56 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580 Sep 02 16:30:56 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:57 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317.73c4fa9d-d341-49e9-b057-c2a5dbbaa580" returned: 0 in 0.313s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-73c4fa9d-d341-49e9-b057-c2a5dbbaa580" released by "_delete_snapshot" :: held 1.929s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" released by "delete_snapshot" :: held 1.956s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:57 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['fffdce34-53e3-49cb-bc32-0c4f29490b44', 'cefd6867-8ab9-41bb-b84d-466f28603db7', 'b430edc0-ce24-47c7-95a2-c911a5c7fc5f', 'fb5e19cf-379c-42bf-9f76-a62828a21d29'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Delete snapshot completed successfully. Sep 02 16:30:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cef279af-5219-443c-ab91-3b7995a64643 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-73c4fa9d-d341-49e9-b057-c2a5dbbaa580-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-23e54d20-8b42-4640-8270-93a02bdfc317-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-23e54d20-8b42-4640-8270-93a02bdfc317-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a893d-6efe-4086-ae57-0c58da5e46bf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:30:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:58 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:58 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:59 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:59 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317 Sep 02 16:30:59 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:59 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-23e54d20-8b42-4640-8270-93a02bdfc317" returned: 0 in 0.287s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-23e54d20-8b42-4640-8270-93a02bdfc317" released by "delete_volume" :: held 0.748s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['3137b413-3c09-40ac-95f2-128b73789a32', '2447c535-2ad3-4fa7-afca-ac7aa446657e', 'b7c0d673-788b-49bb-ade9-49a825b17937', '749b7a44-9715-49a5-b324-819cdde90a40'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:30:59 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:30:59 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:30:59 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.297s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:30:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Deleted volume successfully. Sep 02 16:30:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-150f4909-def6-44cc-b8c5-91b73a753b04 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-23e54d20-8b42-4640-8270-93a02bdfc317-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (72147608-7df8-4bec-9755-573cac62b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a36811d-9581-4f93-b080-8c0f3fe6181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a36811d-9581-4f93-b080-8c0f3fe6181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815490616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00c56ce-edf9-4c7d-97c4-d7df26c49af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:00Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a161eafb-f3ff-4681-a4d8-53c282da309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a161eafb-f3ff-4681-a4d8-53c282da309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d61fd20-a0f0-4800-807a-78906d1eb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d61fd20-a0f0-4800-807a-78906d1eb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00c56ce-edf9-4c7d-97c4-d7df26c49af5', 'volume_name': 'volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b3efda-ad02-4d48-85cd-73e48269f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b3efda-ad02-4d48-85cd-73e48269f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95583f3-b518-4967-ab9c-e32d8db2f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Volume c00c56ce-edf9-4c7d-97c4-d7df26c49af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5', 'volume_size': 1} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815490616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00c56ce-edf9-4c7d-97c4-d7df26c49af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:00Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Creating volume c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:31:00 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:00 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 1073741824 Sep 02 16:31:00 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Flow 'volume_create_manager' (b6056386-71bd-4a81-8cb8-6c08bf5c7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8263bf-cf44-4d0b-911d-084719a2151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8263bf-cf44-4d0b-911d-084719a2151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-410080513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcc9b5f-290a-422a-87f8-b111d9b42e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0497c3f56d1545ffa453dc3bbd63e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:01Z,use_quota=True,user_id='da50392999b54b60a82921c1a284a750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55df77-41d0-4d18-a5c2-e219a8f97b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55df77-41d0-4d18-a5c2-e219a8f97b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afb29e9-08b2-4198-ae89-326c9ed3ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afb29e9-08b2-4198-ae89-326c9ed3ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcc9b5f-290a-422a-87f8-b111d9b42e1c', 'volume_name': 'volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b5bf31-87c9-4d95-bed2-58d037095760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b5bf31-87c9-4d95-bed2-58d037095760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9307402f-9293-4664-a090-4936301ec981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Volume fdcc9b5f-290a-422a-87f8-b111d9b42e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c', 'volume_size': 1} Sep 02 16:31:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:01 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 1073741824" returned: 0 in 0.587s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:01 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:01 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:01 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.310s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-410080513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcc9b5f-290a-422a-87f8-b111d9b42e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0497c3f56d1545ffa453dc3bbd63e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:01Z,use_quota=True,user_id='da50392999b54b60a82921c1a284a750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Creating volume fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:31:01 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:01 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c 1073741824 Sep 02 16:31:01 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95583f3-b518-4967-ab9c-e32d8db2f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc360933-9c24-4ce6-b646-15ba6bf8945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Volume volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 (c00c56ce-edf9-4c7d-97c4-d7df26c49af5): created successfully Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc360933-9c24-4ce6-b646-15ba6bf8945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (72147608-7df8-4bec-9755-573cac62b496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a45673d9-c3ec-4ae5-ab2e-bf03f6cefafb tempest-VolumesSnapshotTestJSON-256307722 None] Created volume successfully. Sep 02 16:31:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-78dd10fb-3940-4d87-b2e2-71aff2ed80dd req-17388ee0-35c9-4fe6-85c1-66ba784431d1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:02 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c 1073741824" returned: 0 in 0.495s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:02 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:31:02 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:02 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-78dd10fb-3940-4d87-b2e2-71aff2ed80dd req-17388ee0-35c9-4fe6-85c1-66ba784431d1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.443s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9307402f-9293-4664-a090-4936301ec981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70e664f-d32c-4e2e-afa7-4b1c08982ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-78dd10fb-3940-4d87-b2e2-71aff2ed80dd req-17388ee0-35c9-4fe6-85c1-66ba784431d1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:02 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Volume volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c (fdcc9b5f-290a-422a-87f8-b111d9b42e1c): created successfully Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70e664f-d32c-4e2e-afa7-4b1c08982ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Flow 'volume_create_manager' (b6056386-71bd-4a81-8cb8-6c08bf5c7c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ece5bbf0-8ecc-4e09-b581-ced3f1f5bc94 tempest-TestStampPattern-1331736909 None] Created volume successfully. Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-78dd10fb-3940-4d87-b2e2-71aff2ed80dd req-17388ee0-35c9-4fe6-85c1-66ba784431d1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16b3c376-75f4-4330-8298-2b9881eafac9', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:31:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-78dd10fb-3940-4d87-b2e2-71aff2ed80dd req-17388ee0-35c9-4fe6-85c1-66ba784431d1 tempest-TestServerVolumeAttachmentScenario-2064753097 None] attachment_update completed successfully. Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Creating offline snapshot 986954d0-d4a3-4843-a456-d7076198fa4e of volume c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42fe540-3f94-46d7-a137-fe5ee7e1fb3f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:03 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:03 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:03 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.511s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:03 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e 1G Sep 02 16:31:03 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:03 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e 1G" returned: 0 in 0.535s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:04 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:04 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:04 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.539s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:04 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e is being set with open permissions: ugo+rw Sep 02 16:31:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:04 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:04 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:04 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-908c7c92-5118-49a3-98ab-5bba72db6547 req-1f8ad9f6-2116-4430-9852-8ea3d3c57c33 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Terminate volume connection completed successfully. Sep 02 16:31:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-908c7c92-5118-49a3-98ab-5bba72db6547 req-1f8ad9f6-2116-4430-9852-8ea3d3c57c33 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Deleting attachment 16b3c376-75f4-4330-8298-2b9881eafac9. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:31:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:04 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info Sep 02 16:31:04 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:05 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:05 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info is being set with open permissions: ugo+rw Sep 02 16:31:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:05 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info Sep 02 16:31:05 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:05 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.info" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-864f1aa3-d829-4592-a3bc-83cf833e7c3e tempest-VolumesSnapshotTestJSON-256307722 None] Create snapshot completed successfully Sep 02 16:31:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-6ad663ee-e4ae-4a58-b8b0-95ba54b3695b req-c5700a74-850c-407d-b096-c8ca72622f92 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Terminate volume connection completed successfully. Sep 02 16:31:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-6ad663ee-e4ae-4a58-b8b0-95ba54b3695b req-c5700a74-850c-407d-b096-c8ca72622f92 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Deleting attachment 83e61ddd-3724-4573-be95-9c25cab603e1. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (4e5b1c5f-5096-4a6d-9c28-54db63b13bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b46da7-686c-4d2e-a2fb-42cb11ad2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b46da7-686c-4d2e-a2fb-42cb11ad2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693204770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1273132-a236-438f-ab81-c117724abb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69d707aaf64487cacea7f17d54c07dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=986954d0-d4a3-4843-a456-d7076198fa4e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:07Z,use_quota=True,user_id='123e9e87f26c4e56b725ab04486ad677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba2a533-6922-4971-ad57-dfeca3cc4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba2a533-6922-4971-ad57-dfeca3cc4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721bce19-cb3e-4b1b-9678-1235c68f4e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721bce19-cb3e-4b1b-9678-1235c68f4e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1273132-a236-438f-ab81-c117724abb00', 'volume_name': 'volume-b1273132-a236-438f-ab81-c117724abb00', 'volume_size': 1, 'snapshot_id': '986954d0-d4a3-4843-a456-d7076198fa4e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db66798a-ebca-4787-9a88-7544e4a3eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db66798a-ebca-4787-9a88-7544e4a3eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cb66a5-b84f-4823-ac58-120260ece5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Volume b1273132-a236-438f-ab81-c117724abb00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1273132-a236-438f-ab81-c117724abb00', 'volume_size': 1, 'snapshot_id': '986954d0-d4a3-4843-a456-d7076198fa4e'} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e-b1273132-a236-438f-ab81-c117724abb00" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e-b1273132-a236-438f-ab81-c117724abb00" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Creating volume b1273132-a236-438f-ab81-c117724abb00 from snapshot 986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] snapshot: 986954d0-d4a3-4843-a456-d7076198fa4e, volume: b1273132-a236-438f-ab81-c117724abb00, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee5162-0b1d-40c1-af5f-54ed4fe0b84f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:07 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:07 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:08 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.571s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2586755b-a19f-49aa-8b94-8c8bbbda039a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:08 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:08 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:08 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.680s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:31:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:08 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 Sep 02 16:31:08 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:15 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00" returned: 0 in 6.842s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:15 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:31:15 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Converted 1024.00 MB image at 149.61 MB/s Sep 02 16:31:15 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 is being set with open permissions: ugo+rw Sep 02 16:31:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:15 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 Sep 02 16:31:15 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:16 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" released by "_copy_volume_from_snapshot" :: held 8.533s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e-b1273132-a236-438f-ab81-c117724abb00" released by "_create_volume_from_snapshot" :: held 8.661s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.692s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cb66a5-b84f-4823-ac58-120260ece5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1273132-a236-438f-ab81-c117724abb00', 'volume_size': 1, 'snapshot_id': '986954d0-d4a3-4843-a456-d7076198fa4e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7486b748-4f73-4f7e-bad5-0245789c9c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Volume volume-b1273132-a236-438f-ab81-c117724abb00 (b1273132-a236-438f-ab81-c117724abb00): created successfully Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7486b748-4f73-4f7e-bad5-0245789c9c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Flow 'volume_create_manager' (4e5b1c5f-5096-4a6d-9c28-54db63b13bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f43e2b59-2422-4357-ba7e-2905d3936bcc tempest-VolumesSnapshotTestJSON-256307722 None] Created volume successfully. Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-b1273132-a236-438f-ab81-c117724abb00-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "cinder-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-b1273132-a236-438f-ab81-c117724abb00-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "cinder-quobyte-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-quobyte-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0b2de-dcb7-467a-9405-f1ff2ced6e5e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" acquired by "delete_volume" :: waited 0.047s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a09f44-95d4-4f3c-bc99-20bbf62dbf5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:16 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb Sep 02 16:31:16 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:16 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 Sep 02 16:31:16 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:17 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" returned: 0 in 0.490s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:17 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb Sep 02 16:31:17 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:17 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00" returned: 0 in 0.557s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:17 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00 Sep 02 16:31:17 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:17 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-quobyte-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb" released by "delete_volume" :: held 0.854s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Created reservations ['d3f54b96-2b2f-4aab-811d-1dc3a5061339', 'bd2187c2-dfab-406d-8369-37be91106bcf', '7e092227-2297-4a4d-a22d-1c9136e74b2e', '79fa61d0-c6ca-4b42-8475-6613f376f3be'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:17 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b1273132-a236-438f-ab81-c117724abb00" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-b1273132-a236-438f-ab81-c117724abb00" released by "delete_volume" :: held 0.931s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:17 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:17 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "cinder-04df9484-4d6b-4093-b5ba-a002344eea66-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['cc48721c-1cee-4165-b06d-8c0422b71370', 'c181eead-e589-43e7-bf5d-5d972d149f6d', 'bcb59122-01f7-4029-8bfd-09c3aa0ebe68', '79455857-0323-456e-b58a-aee9c780ecdf'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-04df9484-4d6b-4093-b5ba-a002344eea66-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "cinder-quobyte-04df9484-4d6b-4093-b5ba-a002344eea66" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-quobyte-04df9484-4d6b-4093-b5ba-a002344eea66" acquired by "delete_volume" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d0e26-7b41-483f-b848-80819e23ff7b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:18 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:18 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:18 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Deleted volume successfully. Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6dfc583-ddcf-44b6-9879-ff81e7954aaf tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-69b97aa8-1c1c-4c0d-9f55-8ccb5a3186fb-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:18 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 Sep 02 16:31:18 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:18 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Deleted volume successfully. Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b67be06-5b5f-4eff-b11f-1416626d0849 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-b1273132-a236-438f-ab81-c117724abb00-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:18 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66" returned: 0 in 0.530s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:18 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66 Sep 02 16:31:18 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:18 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-04df9484-4d6b-4093-b5ba-a002344eea66" returned: 0 in 0.273s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-quobyte-04df9484-4d6b-4093-b5ba-a002344eea66" released by "delete_volume" :: held 0.865s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-986954d0-d4a3-4843-a456-d7076198fa4e-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-986954d0-d4a3-4843-a456-d7076198fa4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Created reservations ['3b8680ce-ef81-4371-9fd0-278ab7b8e338', '330080e4-9283-4412-bbea-717aab4771b4', 'f1866764-f8d3-451e-acec-66f015f4f688', 'd4179d8b-acce-4c39-98d1-2b6064c27dc1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Deleting offline snapshot 986954d0-d4a3-4843-a456-d7076198fa4e of volume c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:31:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] snapshot_file for this snap is: volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa0c416-2d8a-46c7-9a2f-55f39524483e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:19 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:19 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:19 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:19 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:19 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Deleted volume successfully. Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c8ad21e7-93ae-419a-b3f7-54d2a8bf4059 tempest-TestServerVolumeAttachmentScenario-2064753097 None] Lock "cinder-04df9484-4d6b-4093-b5ba-a002344eea66-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:19 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.403s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c700c614-ff3d-477f-8405-567a9945bdff]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:19 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:19 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:19 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.538s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:20 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:20 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:20 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.392s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:20 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e Sep 02 16:31:20 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:20 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5.986954d0-d4a3-4843-a456-d7076198fa4e" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-986954d0-d4a3-4843-a456-d7076198fa4e" released by "_delete_snapshot" :: held 1.701s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" released by "delete_snapshot" :: held 1.748s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['89e571fc-a72e-41d7-824c-1f0b3ba43487', '11f04ac1-c447-49fe-a9d8-344ae6b5ef8c', 'fd27bf2f-df11-4d87-8d37-eb8ab2976581', '22c73b33-8b41-4b3d-9f98-16e27ef936ee'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Delete snapshot completed successfully. Sep 02 16:31:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-183a2fec-3532-4c4e-9d85-e6fde33773de tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-986954d0-d4a3-4843-a456-d7076198fa4e-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-c00c56ce-edf9-4c7d-97c4-d7df26c49af5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-c00c56ce-edf9-4c7d-97c4-d7df26c49af5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[782c2bb8-7b4c-4596-9361-3c606244b19a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:21 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:21 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:21 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.395s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:21 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5 Sep 02 16:31:21 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:21 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-c00c56ce-edf9-4c7d-97c4-d7df26c49af5" released by "delete_volume" :: held 0.761s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['6aa6c52b-dead-4ac3-962d-f90d0c13161a', 'c01bc1da-cdb0-4a11-9699-fbacac93e837', 'da508c22-459b-4032-896a-bc7258751a6c', 'ba0561d8-998e-45a2-9ab5-e1d317450857'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:22 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:22 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:22 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.269s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Deleted volume successfully. Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-d555c029-5bca-466e-a364-4941818e015d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-d555c029-5bca-466e-a364-4941818e015d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e1c07e0d-f42e-4cd8-b370-c7392e6402f8 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-c00c56ce-edf9-4c7d-97c4-d7df26c49af5-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f0266-cd90-4ab3-94f9-dc4a9f53d9c2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:22 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d Sep 02 16:31:22 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:22 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:22 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d Sep 02 16:31:22 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:23 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d555c029-5bca-466e-a364-4941818e015d" returned: 0 in 0.242s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-quobyte-d555c029-5bca-466e-a364-4941818e015d" released by "delete_volume" :: held 0.683s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Created reservations ['ea737027-7dac-4a38-be7b-2bb685f9d6c3', '637bfe12-2ec4-4a37-9a59-312dbbdb2767', '3f47c663-5632-4539-a1a0-9938a31ea720', '8e95e44a-8849-4548-90e9-03808fabde96'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:23 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:23 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:23 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Deleted volume successfully. Sep 02 16:31:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-74589c6e-9b79-4619-9446-3b365f95c946 tempest-VolumesSnapshotTestJSON-256307722 None] Lock "cinder-d555c029-5bca-466e-a364-4941818e015d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:31:33 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=80,cinder:UPDATE=83,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:31:33 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=89,cinder:SELECT=79,cinder:DELETE=8,cinder:INSERT=24 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:31:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3ecbefad-6e66-4273-a128-0da80bfbc542 req-d093208b-fbf0-499a-b982-47d606b61740 tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3ecbefad-6e66-4273-a128-0da80bfbc542 req-d093208b-fbf0-499a-b982-47d606b61740 tempest-TestStampPattern-1331736909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-3ecbefad-6e66-4273-a128-0da80bfbc542 req-d093208b-fbf0-499a-b982-47d606b61740 tempest-TestStampPattern-1331736909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-3ecbefad-6e66-4273-a128-0da80bfbc542 req-d093208b-fbf0-499a-b982-47d606b61740 tempest-TestStampPattern-1331736909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6035122-a545-49e3-93a4-f9e625f71624', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:31:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-3ecbefad-6e66-4273-a128-0da80bfbc542 req-d093208b-fbf0-499a-b982-47d606b61740 tempest-TestStampPattern-1331736909 None] attachment_update completed successfully. Sep 02 16:31:43 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-609060fb-e116-49ac-ba88-312bc7a7887e req-14d12d91-16e6-494b-b07d-76a31fb579d4 tempest-TestStampPattern-1331736909 None] Terminate volume connection completed successfully. Sep 02 16:31:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-609060fb-e116-49ac-ba88-312bc7a7887e req-14d12d91-16e6-494b-b07d-76a31fb579d4 tempest-TestStampPattern-1331736909 None] Deleting attachment a6035122-a545-49e3-93a4-f9e625f71624. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:31:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Creating offline snapshot 471151e4-73bb-4217-a12b-2b9244facf71 of volume fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:31:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721c69c-c194-4b83-8934-14ab6764760f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:45 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:31:45 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:45 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.413s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:45 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 1G Sep 02 16:31:45 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:45 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 1G" returned: 0 in 0.631s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:46 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:31:46 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:46 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:46 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 is being set with open permissions: ugo+rw Sep 02 16:31:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:46 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:31:46 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:46 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:46 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info Sep 02 16:31:46 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:47 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:47 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info is being set with open permissions: ugo+rw Sep 02 16:31:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:47 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info Sep 02 16:31:47 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:47 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.info" returned: 0 in 0.280s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-67fb5bb1-942e-4293-9ae0-9d4f5fd8c0b3 tempest-TestStampPattern-1331736909 None] Create snapshot completed successfully Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:48 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:31:48 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:49 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.372s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:31:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:31:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:31:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Flow 'volume_create_manager' (daf6d079-1ba1-44fb-a6b6-9a6f20dae72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f381a19-a3e9-4a10-99b7-1aaeb1b325a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f381a19-a3e9-4a10-99b7-1aaeb1b325a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-360931073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b7d3b-d42d-448b-bcf0-6e3cf12125da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0497c3f56d1545ffa453dc3bbd63e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=471151e4-73bb-4217-a12b-2b9244facf71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:31:56Z,use_quota=True,user_id='da50392999b54b60a82921c1a284a750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b8943-fcd6-480d-ae29-7889e872ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b8943-fcd6-480d-ae29-7889e872ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae68de1-5056-4b9c-990b-3361d3391171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae68de1-5056-4b9c-990b-3361d3391171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a94b7d3b-d42d-448b-bcf0-6e3cf12125da', 'volume_name': 'volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da', 'volume_size': 1, 'snapshot_id': '471151e4-73bb-4217-a12b-2b9244facf71'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d1bd26-decf-44e4-a7d6-b63f0eba9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d1bd26-decf-44e4-a7d6-b63f0eba9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db7f23-f6be-48c5-b836-6bbe1c7d1510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:31:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Volume a94b7d3b-d42d-448b-bcf0-6e3cf12125da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da', 'volume_size': 1, 'snapshot_id': '471151e4-73bb-4217-a12b-2b9244facf71'} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Creating volume a94b7d3b-d42d-448b-bcf0-6e3cf12125da from snapshot 471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] snapshot: 471151e4-73bb-4217-a12b-2b9244facf71, volume: a94b7d3b-d42d-448b-bcf0-6e3cf12125da, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5eb6aa-45aa-46f3-a27d-85d09e7f60cd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:56 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:31:56 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:56 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.443s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40529091-adce-4a3f-b380-f105155f5171]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:56 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:31:56 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:31:56 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.519s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:31:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:31:56 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da Sep 02 16:31:56 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:03 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" returned: 0 in 6.816s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:03 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:32:03 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Converted 1024.00 MB image at 150.21 MB/s Sep 02 16:32:03 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da is being set with open permissions: ugo+rw Sep 02 16:32:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:03 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da Sep 02 16:32:03 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:04 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" returned: 0 in 0.466s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" released by "_copy_volume_from_snapshot" :: held 8.436s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" released by "_create_volume_from_snapshot" :: held 8.577s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.617s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db7f23-f6be-48c5-b836-6bbe1c7d1510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da', 'volume_size': 1, 'snapshot_id': '471151e4-73bb-4217-a12b-2b9244facf71'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575f80d-1e3c-4016-a884-8e07242dd1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Volume volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da (a94b7d3b-d42d-448b-bcf0-6e3cf12125da): created successfully Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575f80d-1e3c-4016-a884-8e07242dd1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Flow 'volume_create_manager' (daf6d079-1ba1-44fb-a6b6-9a6f20dae72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:32:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b1615bc9-d4d5-479c-b17e-7222ba5f6f3b tempest-TestStampPattern-1331736909 None] Created volume successfully. Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Flow 'volume_create_manager' (b574436f-9d07-42b0-a298-e30d7efc3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973c4670-6858-496e-a261-a1ae2eddc495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973c4670-6858-496e-a261-a1ae2eddc495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-831987330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e62f73-042c-44e7-8e2e-4112ba47cd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41155ba701ad4b1bb0f42604e39bc449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:32:13Z,use_quota=True,user_id='8ac4f5adbe6641b7b0c692f9d1b3d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59384f8c-512b-4398-a286-fbe03c5587bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59384f8c-512b-4398-a286-fbe03c5587bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9807e0d3-e28f-45ae-b4a5-5dbe56895d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:13 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9807e0d3-e28f-45ae-b4a5-5dbe56895d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'volume_name': 'volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35362496-013e-40e3-b174-d12c27b8d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35362496-013e-40e3-b174-d12c27b8d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517bb235-eef5-4dd3-8505-d1a0be802266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Trying to clone 30e62f73-042c-44e7-8e2e-4112ba47cd1d from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:32:14 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Image download 20.69 MB at 20.69 MB/s Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c944b2-7da4-4aa7-98a0-72ed539deeb2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:32:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:15 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD Sep 02 16:32:15 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:15 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:15 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd is fetched for user 8ac4f5adbe6641b7b0c692f9d1b3d584. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:32:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f7027-5080-4c8f-9101-808d45f3eac5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:32:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:15 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD Sep 02 16:32:15 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:16 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-831987330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e62f73-042c-44e7-8e2e-4112ba47cd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41155ba701ad4b1bb0f42604e39bc449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:32:13Z,use_quota=True,user_id='8ac4f5adbe6641b7b0c692f9d1b3d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Creating volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:32:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:16 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1073741824 Sep 02 16:32:16 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:16 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1073741824" returned: 0 in 0.798s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:17 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d Sep 02 16:32:17 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Flow 'volume_create_manager' (2efa3c01-a98f-45b8-88e6-8730316b5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0577e46c-5f5f-403f-bac3-b8504ea6ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0577e46c-5f5f-403f-bac3-b8504ea6ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-758761837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32752b7-6689-428f-af2e-f9f67837e25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3249c32911047b79d89b842b1d033ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:32:17Z,use_quota=True,user_id='7bce2b3545464449a187af353c7ef3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e775b9-b3c0-49cc-bd97-22e50cb4db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:17 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e775b9-b3c0-49cc-bd97-22e50cb4db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57dd35a-22ab-49fe-b135-1b6f43280056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57dd35a-22ab-49fe-b135-1b6f43280056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32752b7-6689-428f-af2e-f9f67837e25f', 'volume_name': 'volume-f32752b7-6689-428f-af2e-f9f67837e25f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0052a9-f8a6-4ed0-991d-e68f0e276e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0052a9-f8a6-4ed0-991d-e68f0e276e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10744b8f-3d9e-403a-8d83-eb9604feeda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Volume f32752b7-6689-428f-af2e-f9f67837e25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32752b7-6689-428f-af2e-f9f67837e25f', 'volume_size': 1} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d" returned: 0 in 0.525s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-758761837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32752b7-6689-428f-af2e-f9f67837e25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3249c32911047b79d89b842b1d033ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:32:17Z,use_quota=True,user_id='7bce2b3545464449a187af353c7ef3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Creating volume f32752b7-6689-428f-af2e-f9f67837e25f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:32:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Attempting download of e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:32:17 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f 1073741824 Sep 02 16:32:17 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3a0a6-2b8b-46ce-8873-d00727a3c267]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:32:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:17 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb Sep 02 16:32:17 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:18 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb" returned: 0 in 0.536s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:18 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f 1073741824" returned: 0 in 0.746s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:18 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f Sep 02 16:32:18 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:18 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb Sep 02 16:32:18 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:18 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f" returned: 0 in 0.338s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10744b8f-3d9e-403a-8d83-eb9604feeda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32752b7-6689-428f-af2e-f9f67837e25f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:18 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28733785-9345-45cf-b61e-3ff6876bb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb" returned: 1 in 0.483s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_odxqsamb' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93788ca6-9be9-4de5-994c-bd6ab86d41e2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Volume volume-f32752b7-6689-428f-af2e-f9f67837e25f (f32752b7-6689-428f-af2e-f9f67837e25f): created successfully Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28733785-9345-45cf-b61e-3ff6876bb071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Flow 'volume_create_manager' (2efa3c01-a98f-45b8-88e6-8730316b5978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:32:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2e468f9e-ac44-4399-8280-89b4920c8f7f tempest-TestMinimumBasicScenario-358930713 None] Created volume successfully. Sep 02 16:32:18 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD Sep 02 16:32:18 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:19 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:19 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd was qcow2, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:32:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:19 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d Sep 02 16:32:19 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-a33dccd8-3483-4bd7-af93-12c840e70628 req-53315fe4-6842-4c5e-8859-5c0c1a9b2cda tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-a33dccd8-3483-4bd7-af93-12c840e70628 req-53315fe4-6842-4c5e-8859-5c0c1a9b2cda tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-a33dccd8-3483-4bd7-af93-12c840e70628 req-53315fe4-6842-4c5e-8859-5c0c1a9b2cda tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:20 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-a33dccd8-3483-4bd7-af93-12c840e70628 req-53315fe4-6842-4c5e-8859-5c0c1a9b2cda tempest-TestMinimumBasicScenario-358930713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-f32752b7-6689-428f-af2e-f9f67837e25f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84ee5de0-52cb-4b10-90d8-068b824f6982', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:32:20 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-a33dccd8-3483-4bd7-af93-12c840e70628 req-53315fe4-6842-4c5e-8859-5c0c1a9b2cda tempest-TestMinimumBasicScenario-358930713 None] attachment_update completed successfully. Sep 02 16:32:21 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d" returned: 0 in 2.185s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd_py5l_qfvdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:32:21 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Converted 112.00 MB image at 51.24 MB/s Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:21 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1G Sep 02 16:32:21 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:21 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d 1G" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Downloaded image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}])) to volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Temporary image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd for user 8ac4f5adbe6641b7b0c692f9d1b3d584 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Marking volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Copying metadata from image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd to 30e62f73-042c-44e7-8e2e-4112ba47cd1d. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Creating volume glance metadata for volume 30e62f73-042c-44e7-8e2e-4112ba47cd1d backed by image e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517bb235-eef5-4dd3-8505-d1a0be802266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'volume_size': 1, 'image_id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adfd78c25d2245f4b9216c9876bfef96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd', 'created_at': datetime.datetime(2026, 9, 2, 14, 12, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 12, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ee91ab-651c-46ee-84b9-13d2dbf7b7cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c25c51-fdd1-4c56-83d2-67ccf123ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:32:21 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Volume volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d (30e62f73-042c-44e7-8e2e-4112ba47cd1d): created successfully Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c25c51-fdd1-4c56-83d2-67ccf123ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:32:21 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Flow 'volume_create_manager' (b574436f-9d07-42b0-a298-e30d7efc3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:32:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-28d0eec4-95b7-45c8-a5e0-3466d4331944 tempest-TestShelveInstance-786353243 None] Created volume successfully. Sep 02 16:32:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-93d27bc7-00bf-4b1e-87ab-a355b384789f req-3b8246bd-6e2b-4410-8d43-5ffb67cff235 tempest-TestShelveInstance-786353243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-93d27bc7-00bf-4b1e-87ab-a355b384789f req-3b8246bd-6e2b-4410-8d43-5ffb67cff235 tempest-TestShelveInstance-786353243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-93d27bc7-00bf-4b1e-87ab-a355b384789f req-3b8246bd-6e2b-4410-8d43-5ffb67cff235 tempest-TestShelveInstance-786353243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-93d27bc7-00bf-4b1e-87ab-a355b384789f req-3b8246bd-6e2b-4410-8d43-5ffb67cff235 tempest-TestShelveInstance-786353243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cb5aab2-901a-488b-b3ac-fa60f30bc3cd', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:32:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-93d27bc7-00bf-4b1e-87ab-a355b384789f req-3b8246bd-6e2b-4410-8d43-5ffb67cff235 tempest-TestShelveInstance-786353243 None] attachment_update completed successfully. Sep 02 16:32:35 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=39,cinder:UPDATE=13,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:32:35 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=40,cinder:UPDATE=21,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:32:48 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:32:48 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:32:49 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 02 16:32:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:32:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:32:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:32:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:32:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:32:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6f650edf-99f6-4ff3-926d-83ac0ca58d01 req-8a4de7b6-aa79-4cbd-a802-46faab80b121 tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:32:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6f650edf-99f6-4ff3-926d-83ac0ca58d01 req-8a4de7b6-aa79-4cbd-a802-46faab80b121 tempest-TestStampPattern-1331736909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:32:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-6f650edf-99f6-4ff3-926d-83ac0ca58d01 req-8a4de7b6-aa79-4cbd-a802-46faab80b121 tempest-TestStampPattern-1331736909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:32:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-6f650edf-99f6-4ff3-926d-83ac0ca58d01 req-8a4de7b6-aa79-4cbd-a802-46faab80b121 tempest-TestStampPattern-1331736909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e11b60d6-5540-4ef0-881c-58fc63e27b7b', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:32:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-6f650edf-99f6-4ff3-926d-83ac0ca58d01 req-8a4de7b6-aa79-4cbd-a802-46faab80b121 tempest-TestStampPattern-1331736909 None] attachment_update completed successfully. Sep 02 16:32:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-73a3b137-6c14-42c1-8d20-bd5f0566c26c req-268dbe44-b47e-4ec9-bbfa-c572362d791c tempest-TestStampPattern-1331736909 None] Terminate volume connection completed successfully. Sep 02 16:32:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-73a3b137-6c14-42c1-8d20-bd5f0566c26c req-268dbe44-b47e-4ec9-bbfa-c572362d791c tempest-TestStampPattern-1331736909 None] Deleting attachment e11b60d6-5540-4ef0-881c-58fc63e27b7b. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-a94b7d3b-d42d-448b-bcf0-6e3cf12125da-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "cinder-a94b7d3b-d42d-448b-bcf0-6e3cf12125da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c08955-5f3d-4fe9-bc51-cf37c3d9d92d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:01 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da Sep 02 16:33:01 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:01 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:01 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da Sep 02 16:33:01 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:01 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" returned: 0 in 0.240s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-a94b7d3b-d42d-448b-bcf0-6e3cf12125da" released by "delete_volume" :: held 0.628s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:01 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Created reservations ['4b15fce8-7c8b-4b45-b8db-26e6f9f036f4', 'c5157525-2b1c-49c5-ac48-036793302f1b', '47642a4c-c8bf-4052-adeb-82a4894f5f2d', '8dbdd101-1afc-444a-b0b5-676ee835f008'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:02 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:02 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:02 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.238s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:02 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Deleted volume successfully. Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4ba7d3be-38b5-4b8b-89dc-ef27985cff0e tempest-TestStampPattern-1331736909 None] Lock "cinder-a94b7d3b-d42d-448b-bcf0-6e3cf12125da-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-471151e4-73bb-4217-a12b-2b9244facf71-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-471151e4-73bb-4217-a12b-2b9244facf71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Deleting offline snapshot 471151e4-73bb-4217-a12b-2b9244facf71 of volume fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] snapshot_file for this snap is: volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114d423-38e8-45f7-a364-fca1ddb16813]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:02 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:33:02 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:03 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7df490-6840-4c08-ace2-4485774d0a32]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:03 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:33:03 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:03 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.525s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:03 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:33:03 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:04 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.327s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:04 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71 Sep 02 16:33:04 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:04 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c.471151e4-73bb-4217-a12b-2b9244facf71" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-471151e4-73bb-4217-a12b-2b9244facf71" released by "_delete_snapshot" :: held 1.610s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" released by "delete_snapshot" :: held 1.635s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Created reservations ['97ddc6bd-52fc-4205-b88b-c4bd3ac52493', 'f8391001-5339-4356-80b3-5e07a6e7869b', '3cc41c2b-fc6a-46ff-a118-3a48bcc5d863', 'eb7e642f-2eb1-465d-ad9d-2d9b904659c2'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Delete snapshot completed successfully. Sep 02 16:33:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-632e5c52-558b-4109-99e5-872db43773fd tempest-TestStampPattern-1331736909 None] Lock "cinder-471151e4-73bb-4217-a12b-2b9244facf71-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-b0633b63-304c-4dba-ae20-16881a99059f req-84677287-c5cb-4bb6-9be5-2fb9f4e1ce90 tempest-TestMinimumBasicScenario-358930713 None] Terminate volume connection completed successfully. Sep 02 16:33:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-b0633b63-304c-4dba-ae20-16881a99059f req-84677287-c5cb-4bb6-9be5-2fb9f4e1ce90 tempest-TestMinimumBasicScenario-358930713 None] Deleting attachment 84ee5de0-52cb-4b10-90d8-068b824f6982. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "cinder-f32752b7-6689-428f-af2e-f9f67837e25f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "cinder-f32752b7-6689-428f-af2e-f9f67837e25f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "cinder-quobyte-f32752b7-6689-428f-af2e-f9f67837e25f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "cinder-quobyte-f32752b7-6689-428f-af2e-f9f67837e25f" acquired by "delete_volume" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c0d29-111d-4058-bec4-864d3dd3074b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:08 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f Sep 02 16:33:08 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:08 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f" returned: 0 in 0.361s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:08 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f Sep 02 16:33:08 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:08 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f32752b7-6689-428f-af2e-f9f67837e25f" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "cinder-quobyte-f32752b7-6689-428f-af2e-f9f67837e25f" released by "delete_volume" :: held 0.646s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-fdcc9b5f-290a-422a-87f8-b111d9b42e1c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "cinder-fdcc9b5f-290a-422a-87f8-b111d9b42e1c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Created reservations ['9e2dbce1-81bc-47d7-bfba-d3cac9863208', '13cf5e1f-27e4-4c33-a771-7970f13bdecb', '95920ac0-a92b-4482-beee-b7c3e0f9d895', '2b1c05bb-d971-4b49-b3dd-5b79f53593a0'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Acquiring lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c38e9c-3a85-4649-9da3-2812f92fed1c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:08 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:08 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:09 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:33:09 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:09 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Deleted volume successfully. Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ff3f3df3-964a-4c1a-9b0e-b943563181b2 tempest-TestMinimumBasicScenario-358930713 None] Lock "cinder-f32752b7-6689-428f-af2e-f9f67837e25f-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:09 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.384s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:09 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c Sep 02 16:33:09 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:09 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "cinder-quobyte-fdcc9b5f-290a-422a-87f8-b111d9b42e1c" released by "delete_volume" :: held 0.747s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Created reservations ['85aaae9d-eee3-41eb-8e6d-899771f94fc3', '3f2fc01f-0d37-4e5d-b146-34b53533f606', '87dc2575-a78a-4b65-b62d-8376564bddd8', 'e4519f97-0735-41da-98a6-3aacf876229b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:09 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:09 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:10 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:10 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:10 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Deleted volume successfully. Sep 02 16:33:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-350bd4bc-e3f4-46ea-9910-5913b95388ce tempest-TestStampPattern-1331736909 None] Lock "cinder-fdcc9b5f-290a-422a-87f8-b111d9b42e1c-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-ea954c1a-dae3-428d-8f6e-b16bfe4722cb req-599dc5ce-7502-41b8-bc13-5c32f5c95926 tempest-TestShelveInstance-786353243 None] Terminate volume connection completed successfully. Sep 02 16:33:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-ea954c1a-dae3-428d-8f6e-b16bfe4722cb req-599dc5ce-7502-41b8-bc13-5c32f5c95926 tempest-TestShelveInstance-786353243 None] Deleting attachment 5cb5aab2-901a-488b-b3ac-fa60f30bc3cd. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:33:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ae05c97a-1dbd-49b2-b308-71c4873ed300 req-0cbecbf1-a82e-438a-a15c-9e3eed189df6 tempest-TestShelveInstance-786353243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ae05c97a-1dbd-49b2-b308-71c4873ed300 req-0cbecbf1-a82e-438a-a15c-9e3eed189df6 tempest-TestShelveInstance-786353243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-ae05c97a-1dbd-49b2-b308-71c4873ed300 req-0cbecbf1-a82e-438a-a15c-9e3eed189df6 tempest-TestShelveInstance-786353243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-ae05c97a-1dbd-49b2-b308-71c4873ed300 req-0cbecbf1-a82e-438a-a15c-9e3eed189df6 tempest-TestShelveInstance-786353243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd', 'name': 'volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '589048b2-a122-476d-bd63-97a6b653231e', 'enforce_multipath': True} {{(pid=87051) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 16:33:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-ae05c97a-1dbd-49b2-b308-71c4873ed300 req-0cbecbf1-a82e-438a-a15c-9e3eed189df6 tempest-TestShelveInstance-786353243 None] attachment_update completed successfully. Sep 02 16:33:29 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:33:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Flow 'volume_create_manager' (6e17037d-2a0b-48e6-8584-143b2a72639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a268fc-8e88-4335-ae45-a1c46e8c511c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a268fc-8e88-4335-ae45-a1c46e8c511c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e6a38d-5ce9-4779-8bdd-85b9c6867648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e582dbefa64c4bb21b1af68d381899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:30Z,use_quota=True,user_id='75aae9c91bec4eb0aab480e142e90f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cff842d6-55bf-480a-834f-f56e26fad0d2),volume_type_id=cff842d6-55bf-480a-834f-f56e26fad0d2)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52178832-c089-47a0-bff4-f2836b9b5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52178832-c089-47a0-bff4-f2836b9b5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d875b481-ef13-4915-981b-3480909e8d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d875b481-ef13-4915-981b-3480909e8d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05e6a38d-5ce9-4779-8bdd-85b9c6867648', 'volume_name': 'volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648', 'volume_size': 1, 'image_id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c49c96df3ff5ac70f93085ad300cac06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34e582dbefa64c4bb21b1af68d381899', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfed811ae7340924ea00d5967e40bfab4acd9a03dd81f86e4b1d047defe99fe8f75406e9a9fcb96443e279cfcb14dde9cf80a476be621c9aed7a69c7a2c186f', 'id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'created_at': datetime.datetime(2026, 9, 2, 14, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ecd3f6-37b0-47c8-b4c0-63055967c258/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7131ef28-09ce-4710-bb0f-635833cb8277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7131ef28-09ce-4710-bb0f-635833cb8277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ad73bf-681a-4daf-8484-feca3f538e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648', 'volume_size': 1, 'image_id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c49c96df3ff5ac70f93085ad300cac06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34e582dbefa64c4bb21b1af68d381899', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfed811ae7340924ea00d5967e40bfab4acd9a03dd81f86e4b1d047defe99fe8f75406e9a9fcb96443e279cfcb14dde9cf80a476be621c9aed7a69c7a2c186f', 'id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'created_at': datetime.datetime(2026, 9, 2, 14, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ecd3f6-37b0-47c8-b4c0-63055967c258/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Trying to clone 05e6a38d-5ce9-4779-8bdd-85b9c6867648 from image 90ecd3f6-37b0-47c8-b4c0-63055967c258 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:33:30 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Image download 0.00 MB at 0.00 MB/s Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc2014e-531c-4977-aaaa-36ee3067922b]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:30 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:30 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:30 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:31 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:31 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:31 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Temporary image 90ecd3f6-37b0-47c8-b4c0-63055967c258 is fetched for user 75aae9c91bec4eb0aab480e142e90f31. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c4251-1294-4df3-86fb-a9d722859f9c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:31 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:31 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:31 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:31 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:31 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:32 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e6a38d-5ce9-4779-8bdd-85b9c6867648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e582dbefa64c4bb21b1af68d381899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:30Z,use_quota=True,user_id='75aae9c91bec4eb0aab480e142e90f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cff842d6-55bf-480a-834f-f56e26fad0d2),volume_type_id=cff842d6-55bf-480a-834f-f56e26fad0d2)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Creating volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:33:32 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:32 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1073741824 Sep 02 16:33:32 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:32 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1073741824" returned: 0 in 0.668s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:32 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 Sep 02 16:33:32 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:33 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Attempting download of 90ecd3f6-37b0-47c8-b4c0-63055967c258 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}])) to volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b027c5af-1809-452d-8255-92fb9498a341]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:33 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm Sep 02 16:33:33 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:33 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm" returned: 0 in 0.471s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:33 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm Sep 02 16:33:33 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:34 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm" returned: 1 in 0.429s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ecd3f6-37b0-47c8-b4c0-63055967c258_y5gi6egm' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40837e45-d59c-4fd3-8f3f-90d4a2eaf1f7]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:34 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:34 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:34 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:34 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD Sep 02 16:33:34 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:35 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] 90ecd3f6-37b0-47c8-b4c0-63055967c258 was raw, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:35 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 Sep 02 16:33:35 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:35 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648" returned: 0 in 0.652s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ecd3f6-37b0-47c8-b4c0-63055967c258_bmm307trdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:33:35 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 16:33:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:35 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1G Sep 02 16:33:35 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:36 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 1G" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Downloaded image 90ecd3f6-37b0-47c8-b4c0-63055967c258 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}])) to volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Temporary image 90ecd3f6-37b0-47c8-b4c0-63055967c258 for user 75aae9c91bec4eb0aab480e142e90f31 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Marking volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Copying metadata from image 90ecd3f6-37b0-47c8-b4c0-63055967c258 to 05e6a38d-5ce9-4779-8bdd-85b9c6867648. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Creating volume glance metadata for volume 05e6a38d-5ce9-4779-8bdd-85b9c6867648 backed by image 90ecd3f6-37b0-47c8-b4c0-63055967c258 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c49c96df3ff5ac70f93085ad300cac06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ad73bf-681a-4daf-8484-feca3f538e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648', 'volume_size': 1, 'image_id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ecd3f6-37b0-47c8-b4c0-63055967c258', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c49c96df3ff5ac70f93085ad300cac06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34e582dbefa64c4bb21b1af68d381899', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfed811ae7340924ea00d5967e40bfab4acd9a03dd81f86e4b1d047defe99fe8f75406e9a9fcb96443e279cfcb14dde9cf80a476be621c9aed7a69c7a2c186f', 'id': '90ecd3f6-37b0-47c8-b4c0-63055967c258', 'created_at': datetime.datetime(2026, 9, 2, 14, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ecd3f6-37b0-47c8-b4c0-63055967c258/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ed8063-ce70-4018-a365-e9501c63e5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:36 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Volume volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 (05e6a38d-5ce9-4779-8bdd-85b9c6867648): created successfully Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ed8063-ce70-4018-a365-e9501c63e5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Flow 'volume_create_manager' (6e17037d-2a0b-48e6-8584-143b2a72639b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-af677877-d089-40d2-8bfe-706e4a9fcfaa tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Created volume successfully. Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Acquiring lock "cinder-05e6a38d-5ce9-4779-8bdd-85b9c6867648-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "cinder-05e6a38d-5ce9-4779-8bdd-85b9c6867648-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Acquiring lock "cinder-quobyte-05e6a38d-5ce9-4779-8bdd-85b9c6867648" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "cinder-quobyte-05e6a38d-5ce9-4779-8bdd-85b9c6867648" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e2e3ab-2b7f-43ee-99f0-0b5f74a032ad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:36 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 Sep 02 16:33:36 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:36 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:36 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648 Sep 02 16:33:36 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:37 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-05e6a38d-5ce9-4779-8bdd-85b9c6867648" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "cinder-quobyte-05e6a38d-5ce9-4779-8bdd-85b9c6867648" released by "delete_volume" :: held 0.719s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:37 devstack cinder-volume[87051]: WARNING cinder.quota [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:33:37 devstack cinder-volume[87051]: WARNING cinder.quota [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Created reservations ['c7e42481-684f-470a-84de-47a25dc925d3', 'cd68463c-203c-42cd-bf69-c6d306a1d4e7', '7990e022-033a-46a3-9e98-77f9aa281f89', 'e9223b4b-2eb1-461e-bd3d-c8caef34b075'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:37 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:37 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:37 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Deleted volume successfully. Sep 02 16:33:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-20161fd5-708e-48b7-887e-dcf7ea43cd07 tempest-VolumeAndVolumeTypeFromImageTest-1775245218 None] Lock "cinder-05e6a38d-5ce9-4779-8bdd-85b9c6867648-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Flow 'volume_create_manager' (e9a34a20-bf79-4a01-9062-34f67c7183d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aeb990-1646-44fd-988a-71fdec1a2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aeb990-1646-44fd-988a-71fdec1a2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-164253611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f69bcad-4c36-49b2-9269-1926450d7a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820339f59e704667b1c8c4193d02e77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:43Z,use_quota=True,user_id='855d45cd89964b35a87b1b64eee52d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808460ba-6013-43e9-9fd6-1f12792512e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808460ba-6013-43e9-9fd6-1f12792512e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d002200d-ef04-435d-87e0-7a9c7cac16ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d002200d-ef04-435d-87e0-7a9c7cac16ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f69bcad-4c36-49b2-9269-1926450d7a86', 'volume_name': 'volume-1f69bcad-4c36-49b2-9269-1926450d7a86', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01cfac-01a6-4150-a697-016975747a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01cfac-01a6-4150-a697-016975747a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6dbcce-b1e0-48b2-bdde-ad7a300f07a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:43 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Volume 1f69bcad-4c36-49b2-9269-1926450d7a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f69bcad-4c36-49b2-9269-1926450d7a86', 'volume_size': 1} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-164253611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f69bcad-4c36-49b2-9269-1926450d7a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820339f59e704667b1c8c4193d02e77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:43Z,use_quota=True,user_id='855d45cd89964b35a87b1b64eee52d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Creating volume 1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:33:43 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:43 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 1073741824 Sep 02 16:33:43 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:43 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 1073741824" returned: 0 in 0.458s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:43 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:33:43 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:44 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6dbcce-b1e0-48b2-bdde-ad7a300f07a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f69bcad-4c36-49b2-9269-1926450d7a86', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563cf17-af2c-4116-8c6d-713dfe78011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:44 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Volume volume-1f69bcad-4c36-49b2-9269-1926450d7a86 (1f69bcad-4c36-49b2-9269-1926450d7a86): created successfully Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563cf17-af2c-4116-8c6d-713dfe78011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:44 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Flow 'volume_create_manager' (e9a34a20-bf79-4a01-9062-34f67c7183d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c49bd065-2592-4669-8c3e-224b56ef3bd5 tempest-VolumeDependencyTests-1715371144 None] Created volume successfully. Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Creating offline snapshot 48f83db6-2c7f-4e02-9ad0-64682e8d704e of volume 1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39d031-435d-4c73-96c9-4d36a0bdf1ed]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:45 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:33:45 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:45 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.368s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:45 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e 1G Sep 02 16:33:45 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:46 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e 1G" returned: 0 in 0.431s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f69bcad-4c36-49b2-9269-1926450d7a86 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:46 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f69bcad-4c36-49b2-9269-1926450d7a86 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:46 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:46 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f69bcad-4c36-49b2-9269-1926450d7a86 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.311s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:46 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e is being set with open permissions: ugo+rw Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:46 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:46 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:46 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.268s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=56,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=51,cinder:UPDATE=51,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:33:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:46 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info Sep 02 16:33:46 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:47 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:47 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info is being set with open permissions: ugo+rw Sep 02 16:33:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:47 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info Sep 02 16:33:47 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:47 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.info" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a06aa462-7105-4fa6-8c80-366801be9029 tempest-VolumeDependencyTests-1715371144 None] Create snapshot completed successfully Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Flow 'volume_create_manager' (39a4859f-15af-429c-a9df-390405de4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935bf920-9e91-4c2a-8598-c54459bec723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935bf920-9e91-4c2a-8598-c54459bec723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-235630338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fe6e3e-f6ad-4bf4-a639-33af4e1549cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820339f59e704667b1c8c4193d02e77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48f83db6-2c7f-4e02-9ad0-64682e8d704e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:48Z,use_quota=True,user_id='855d45cd89964b35a87b1b64eee52d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44252179-657a-444d-ac1b-8d41e1531052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44252179-657a-444d-ac1b-8d41e1531052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab124064-1f9e-44f4-8ca8-5634aa3334c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab124064-1f9e-44f4-8ca8-5634aa3334c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45fe6e3e-f6ad-4bf4-a639-33af4e1549cf', 'volume_name': 'volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf', 'volume_size': 1, 'snapshot_id': '48f83db6-2c7f-4e02-9ad0-64682e8d704e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440ae249-06fe-4296-8534-4b077e860b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440ae249-06fe-4296-8534-4b077e860b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a310603a-4274-477a-8cae-f3117c37f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Volume 45fe6e3e-f6ad-4bf4-a639-33af4e1549cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf', 'volume_size': 1, 'snapshot_id': '48f83db6-2c7f-4e02-9ad0-64682e8d704e'} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Creating volume 45fe6e3e-f6ad-4bf4-a639-33af4e1549cf from snapshot 48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] snapshot: 48f83db6-2c7f-4e02-9ad0-64682e8d704e, volume: 45fe6e3e-f6ad-4bf4-a639-33af4e1549cf, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7ea0e-7eeb-488e-8c48-f5f80e9555a6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:48 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:48 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:48 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:48 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:48 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.427s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f69bcad-4c36-49b2-9269-1926450d7a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a8f7a1-8d6e-475e-a4d7-7e7284fd6f27]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:48 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:33:48 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:49 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.334s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:33:49 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:33:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:49 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf Sep 02 16:33:49 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:54 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" returned: 0 in 5.657s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:54 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:33:54 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Converted 1024.00 MB image at 180.99 MB/s Sep 02 16:33:54 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf is being set with open permissions: ugo+rw Sep 02 16:33:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:54 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf Sep 02 16:33:54 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:55 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Flow 'volume_create_manager' (9c8a6f25-abb3-464b-a3dc-006e22820dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb4d6f1-19cb-4ac0-ad34-49d3d7930f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" returned: 0 in 0.460s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb4d6f1-19cb-4ac0-ad34-49d3d7930f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-623467914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301e20c6e9c442d1aa8db309d02d0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:55Z,use_quota=True,user_id='aef14942480e444eac7210af2dbc1b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d37ca7-4599-4c1e-8097-e7668e555760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d37ca7-4599-4c1e-8097-e7668e555760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cf79b3-bae2-49a5-b367-bea64e1dbaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cf79b3-bae2-49a5-b367-bea64e1dbaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8', 'volume_name': 'volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9efcc2-a958-4192-88a1-42e494765233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9efcc2-a958-4192-88a1-42e494765233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576af4f5-5477-4d74-8d58-fea36774a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Volume 5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8', 'volume_size': 1} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" released by "_copy_volume_from_snapshot" :: held 7.180s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" released by "_create_volume_from_snapshot" :: held 7.303s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.324s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-623467914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301e20c6e9c442d1aa8db309d02d0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:33:55Z,use_quota=True,user_id='aef14942480e444eac7210af2dbc1b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Creating volume 5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:33:55 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:55 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 1073741824 Sep 02 16:33:55 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a310603a-4274-477a-8cae-f3117c37f884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf', 'volume_size': 1, 'snapshot_id': '48f83db6-2c7f-4e02-9ad0-64682e8d704e'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9483450f-65e7-429b-a705-caa640dbf759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:55 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Volume volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf (45fe6e3e-f6ad-4bf4-a639-33af4e1549cf): created successfully Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9483450f-65e7-429b-a705-caa640dbf759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:55 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Flow 'volume_create_manager' (39a4859f-15af-429c-a9df-390405de4006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ee096d98-743d-4bce-91bd-cbe42ceb3191 tempest-VolumeDependencyTests-1715371144 None] Created volume successfully. Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-48f83db6-2c7f-4e02-9ad0-64682e8d704e-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-48f83db6-2c7f-4e02-9ad0-64682e8d704e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:56 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Deleting offline snapshot 48f83db6-2c7f-4e02-9ad0-64682e8d704e of volume 1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] snapshot_file for this snap is: volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 1073741824" returned: 0 in 0.565s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c0dbb3-26e9-4674-b75c-c9b760c7222a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:56 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:33:56 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:56 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:56 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:56 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.336s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576af4f5-5477-4d74-8d58-fea36774a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5295e1-8641-4a36-82b2-42b5c82655ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:33:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Volume volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 (5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8): created successfully Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5295e1-8641-4a36-82b2-42b5c82655ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Flow 'volume_create_manager' (9c8a6f25-abb3-464b-a3dc-006e22820dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:33:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3bbb91af-f6d4-423d-99b6-277660a67fb9 tempest-TestImageHashVerification-825704449 None] Created volume successfully. Sep 02 16:33:56 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.491s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f69bcad-4c36-49b2-9269-1926450d7a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9f3bbb-eed6-42de-b80b-937f08d503a7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:56 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-79981492-c610-4bdb-adae-67ee3c220241 tempest-TestShelveInstance-786353243 None] Terminate volume connection completed successfully. Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-79981492-c610-4bdb-adae-67ee3c220241 tempest-TestShelveInstance-786353243 None] Deleting attachment 589048b2-a122-476d-bd63-97a6b653231e. {{(pid=87051) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 16:33:56 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:33:56 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Acquiring lock "cinder-30e62f73-042c-44e7-8e2e-4112ba47cd1d-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "cinder-30e62f73-042c-44e7-8e2e-4112ba47cd1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Acquiring lock "cinder-quobyte-30e62f73-042c-44e7-8e2e-4112ba47cd1d" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "cinder-quobyte-30e62f73-042c-44e7-8e2e-4112ba47cd1d" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92454288-001f-420b-8f3c-ca5cb46a94dc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:57 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d Sep 02 16:33:57 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:57 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.617s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:57 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:57 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:57 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d" returned: 0 in 0.443s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:57 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d Sep 02 16:33:57 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:57 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.474s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:57 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-30e62f73-042c-44e7-8e2e-4112ba47cd1d" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:57 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "cinder-quobyte-30e62f73-042c-44e7-8e2e-4112ba47cd1d" released by "delete_volume" :: held 0.802s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:57 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG cinder.quota [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Created reservations ['a615c5c0-0a17-40e0-9143-352f9f38ca5b', 'e475ec16-701d-41cc-aa45-5bc73f493816', '32f12bab-e8df-4b3d-864e-ec0fa2c44e99', 'ca1c326a-917a-4c54-bf9e-92bf10be8a1a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:33:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:57 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:33:57 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:58 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86.48f83db6-2c7f-4e02-9ad0-64682e8d704e" returned: 0 in 0.341s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-48f83db6-2c7f-4e02-9ad0-64682e8d704e" released by "_delete_snapshot" :: held 2.075s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" released by "delete_snapshot" :: held 2.102s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:58 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.manager [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:33:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Deleted volume successfully. Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Created reservations ['01b08068-7830-451b-a88f-b7458cfc624b', '7c9b72e3-a628-4051-bdce-30ea91406900', '57ba296b-94a6-4bf0-9670-89ee50d36527', 'f29f36df-2f55-4175-a7ff-006d0d06a057'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [req-88804f19-f0c5-4986-8be1-31fe2873ee17 req-dfcc8d49-0302-4ab9-a1d0-1074d7f69e32 tempest-TestShelveInstance-786353243 None] Lock "cinder-30e62f73-042c-44e7-8e2e-4112ba47cd1d-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Delete snapshot completed successfully. Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6265869b-e291-48c1-bffc-5a07fa8c1caf tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-48f83db6-2c7f-4e02-9ad0-64682e8d704e-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[405c5c6d-3a85-48b3-b082-497fd5dd16cc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:58 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:33:58 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:58 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc0e3ce-40bd-4070-bcce-c89079b148c6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:58 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:33:58 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:59 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 /opt/stack/data/cinder/conversion/5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8.temp_image.20958960-95ef-481b-91bc-ed6265a7aa7az3z3dkpb.img {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:59 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 /opt/stack/data/cinder/conversion/5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8.temp_image.20958960-95ef-481b-91bc-ed6265a7aa7az3z3dkpb.img Sep 02 16:33:59 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-1f69bcad-4c36-49b2-9269-1926450d7a86-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-1f69bcad-4c36-49b2-9269-1926450d7a86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c29036-2c0f-449a-b67b-7268fcbf381c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:33:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:33:59 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:33:59 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:00 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.749s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:00 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86 Sep 02 16:34:00 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:00 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-1f69bcad-4c36-49b2-9269-1926450d7a86" returned: 0 in 0.744s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-1f69bcad-4c36-49b2-9269-1926450d7a86" released by "delete_volume" :: held 1.603s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Created reservations ['60733898-b690-4c76-b32c-0509bd072d78', 'e68c0c0f-65e6-459f-856f-4514974699b6', 'a3c6cc9a-4edd-4f93-938c-dacd9dcdaea9', '18ba0dc5-1333-45a6-a8f1-8e89ebaeb7d8'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:01 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:01 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:01 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.616s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:01 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Deleted volume successfully. Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45abd7d4-b1f5-474d-8b1b-4cb8910edcff tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-1f69bcad-4c36-49b2-9269-1926450d7a86-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba5e7b-e330-4ebf-b4e3-42bf5d79948d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:02 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf Sep 02 16:34:02 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:03 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" returned: 0 in 1.015s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:03 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf Sep 02 16:34:03 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:04 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" returned: 0 in 0.808s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-quobyte-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf" released by "delete_volume" :: held 1.937s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Created reservations ['3374a234-6903-4136-b2c4-d3e5280f681a', '1b5a7374-bdec-4f7a-9c80-0284c69950e2', '0e9523a5-00bf-45c8-893c-69ece9564518', '3d1f6be6-530c-4ee3-81da-d3c096a4dd16'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:04 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 /opt/stack/data/cinder/conversion/5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8.temp_image.20958960-95ef-481b-91bc-ed6265a7aa7az3z3dkpb.img" returned: 0 in 5.146s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9683725-4ece-46e2-837c-9818785e2e37]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:04 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:04 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:04 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:34:04 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:04 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Deleted volume successfully. Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-813d0d53-8c8f-4e7b-8eba-33109816691e tempest-VolumeDependencyTests-1715371144 None] Lock "cinder-45fe6e3e-f6ad-4bf4-a639-33af4e1549cf-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:04 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.575s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8.temp_image.20958960-95ef-481b-91bc-ed6265a7aa7az3z3dkpb.img {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:34:04 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Converted 1024.00 MB image at 198.93 MB/s Sep 02 16:34:04 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] 20958960-95ef-481b-91bc-ed6265a7aa7a was raw, no need to convert to raw {{(pid=87051) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (aff59e8a-af30-460f-b3b3-8d910ff1f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fb3cc6-f49e-48b0-888e-7d5b9e735134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fb3cc6-f49e-48b0-888e-7d5b9e735134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779950626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3fd02e-551e-430c-aff4-5a2a353efdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:14Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eac683-5f18-477c-9e6c-f9a9368a2327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eac683-5f18-477c-9e6c-f9a9368a2327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5977c5dd-ae6a-4544-be33-b4141e4a930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5977c5dd-ae6a-4544-be33-b4141e4a930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3fd02e-551e-430c-aff4-5a2a353efdd8', 'volume_name': 'volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6889e367-58c6-46b6-a8b2-c760b45168a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6889e367-58c6-46b6-a8b2-c760b45168a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827e236a-9e09-4832-a415-b5cc27f8cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume 6e3fd02e-551e-430c-aff4-5a2a353efdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8', 'volume_size': 1} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:14 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=36,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=26,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=5 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.423s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Uploaded volume to glance image-id: 20958960-95ef-481b-91bc-ed6265a7aa7a. {{(pid=87051) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.240s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779950626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3fd02e-551e-430c-aff4-5a2a353efdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:14Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume 6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:24 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:24 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 1073741824 Sep 02 16:34:24 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-54246a06-5ba0-463c-9013-95e19d145820 tempest-TestImageHashVerification-825704449 None] Copy volume to image completed successfully. Sep 02 16:34:25 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 1073741824" returned: 0 in 0.401s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:25 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 Sep 02 16:34:25 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:25 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827e236a-9e09-4832-a415-b5cc27f8cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc01c9c4-21ea-47ba-a824-9cd087d918c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:25 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 (6e3fd02e-551e-430c-aff4-5a2a353efdd8): created successfully Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc01c9c4-21ea-47ba-a824-9cd087d918c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (aff59e8a-af30-460f-b3b3-8d910ff1f983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ff2f4e6a-6a68-4cc6-9542-55bd64420222 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Acquiring lock "cinder-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "cinder-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Acquiring lock "cinder-quobyte-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "cinder-quobyte-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb92c2-f6c7-49c0-b8f6-86d0b8dfef2b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:26 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:34:26 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating offline snapshot 066d0746-29cf-4f01-8185-9380810f280a of volume 6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[315aa97e-5114-4775-ba02-c7a1f1fdb3bd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:26 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 Sep 02 16:34:26 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:26 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:26 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8 Sep 02 16:34:26 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:26 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" returned: 0 in 0.243s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:26 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "cinder-quobyte-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8" released by "delete_volume" :: held 0.667s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:26 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a 1G Sep 02 16:34:26 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Created reservations ['03b43284-69c2-4f50-adbb-b000ec07e034', '8f1cc06d-3850-42ab-860c-55c0d0ba06d4', '1c9a098e-0697-438d-a13e-31bf8da75f22', '9200ad13-6f48-4b0a-a10f-8ec8bb8a457b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:26 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:26 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:27 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:27 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a 1G" returned: 0 in 0.401s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Deleted volume successfully. Sep 02 16:34:27 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a Sep 02 16:34:27 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-90568c8d-330a-490f-b38b-c0c3c1f91add tempest-TestImageHashVerification-825704449 None] Lock "cinder-5df6f6c1-7e0e-4f88-abb9-aac3f512d8d8-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:27 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:27 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a is being set with open permissions: ugo+rw Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:27 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a Sep 02 16:34:27 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:27 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:27 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info Sep 02 16:34:27 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:27 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:27 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info is being set with open permissions: ugo+rw Sep 02 16:34:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:28 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info Sep 02 16:34:28 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:28 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.info" returned: 0 in 0.248s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1ee066f4-dfae-4666-8ace-2246c9a5a58d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Create snapshot completed successfully Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9d2e3e31-d3ac-4043-a8f3-b4f427241b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f01b72-c2db-4398-9187-58de692f57d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f01b72-c2db-4398-9187-58de692f57d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704431399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305a6851-4162-4455-aaf0-098e77e16e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:29Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4edc8f-0036-4076-a3e7-eff78f02aef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4edc8f-0036-4076-a3e7-eff78f02aef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5478cb-a796-400a-8764-3dc4274b79ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5478cb-a796-400a-8764-3dc4274b79ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305a6851-4162-4455-aaf0-098e77e16e0a', 'volume_name': 'volume-305a6851-4162-4455-aaf0-098e77e16e0a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06dace-4318-4b36-b5a3-4f22465b57f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06dace-4318-4b36-b5a3-4f22465b57f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606ae2ec-5721-4d81-91f5-636faad31619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:28 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume 305a6851-4162-4455-aaf0-098e77e16e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305a6851-4162-4455-aaf0-098e77e16e0a', 'volume_size': 1} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704431399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305a6851-4162-4455-aaf0-098e77e16e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:29Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume 305a6851-4162-4455-aaf0-098e77e16e0a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:28 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:29 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a 1073741824 Sep 02 16:34:29 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (8874743a-ca0c-48b8-9911-f5fc8445a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007f01c0-df02-496c-9a4c-8d6670ac7fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007f01c0-df02-496c-9a4c-8d6670ac7fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673116638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd2c55-baef-419d-8034-3fee04614a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:29Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2261ba4-381a-4d62-b78f-1e8bc088c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2261ba4-381a-4d62-b78f-1e8bc088c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93fdb45-273c-4a35-bd1d-61889d5d985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93fdb45-273c-4a35-bd1d-61889d5d985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbd2c55-baef-419d-8034-3fee04614a5a', 'volume_name': 'volume-ebbd2c55-baef-419d-8034-3fee04614a5a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2abd776-b508-47e2-9cee-b77783c1cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2abd776-b508-47e2-9cee-b77783c1cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70894e-84a0-4f44-8410-92a47f08764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume ebbd2c55-baef-419d-8034-3fee04614a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbd2c55-baef-419d-8034-3fee04614a5a', 'volume_size': 1} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:29 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a 1073741824" returned: 0 in 0.514s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:29 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a Sep 02 16:34:29 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (8b7ae152-fa77-41e8-9559-bc981ce9a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6361252-c339-489a-a744-f094f436ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6361252-c339-489a-a744-f094f436ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131206809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98423288-4053-4cfe-9638-dcd4a68a9347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7710b4a-30b9-4ba6-9e6f-0ee581735eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7710b4a-30b9-4ba6-9e6f-0ee581735eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14a445a-ca74-45e3-8cc3-23f0dab14d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14a445a-ca74-45e3-8cc3-23f0dab14d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98423288-4053-4cfe-9638-dcd4a68a9347', 'volume_name': 'volume-98423288-4053-4cfe-9638-dcd4a68a9347', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57c1b4a-ff1b-4807-910e-b33dda44b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57c1b4a-ff1b-4807-910e-b33dda44b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a19a58-71d0-45ba-a56d-53940e2c4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:29 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume 98423288-4053-4cfe-9638-dcd4a68a9347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98423288-4053-4cfe-9638-dcd4a68a9347', 'volume_size': 1} Sep 02 16:34:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:30 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673116638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd2c55-baef-419d-8034-3fee04614a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:29Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume ebbd2c55-baef-419d-8034-3fee04614a5a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606ae2ec-5721-4d81-91f5-636faad31619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305a6851-4162-4455-aaf0-098e77e16e0a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dc3c7e-5ae2-4006-a870-7cea94e05a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a 1073741824 Sep 02 16:34:30 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-305a6851-4162-4455-aaf0-098e77e16e0a (305a6851-4162-4455-aaf0-098e77e16e0a): created successfully Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dc3c7e-5ae2-4006-a870-7cea94e05a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9d2e3e31-d3ac-4043-a8f3-b4f427241b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-01b08f50-cfac-435b-b785-fadf958e65c8 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9446ecde-8d85-4e83-8d13-3a8d4f441531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b93883e-a2af-4c0b-88df-362ad4eb0897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b93883e-a2af-4c0b-88df-362ad4eb0897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362657451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21fbe58-b890-4a6c-b5c3-32d20db86f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9be580c-ce80-4741-a3ff-9d8c55f28c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9be580c-ce80-4741-a3ff-9d8c55f28c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc1062-377d-417b-a35f-cad2541d4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc1062-377d-417b-a35f-cad2541d4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21fbe58-b890-4a6c-b5c3-32d20db86f44', 'volume_name': 'volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7497dbe5-b71a-4ead-80fd-871bc583fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7497dbe5-b71a-4ead-80fd-871bc583fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35c2533-ce84-43fa-9204-a9853de19f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume a21fbe58-b890-4a6c-b5c3-32d20db86f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44', 'volume_size': 1} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9536cc19-9870-4916-aed7-3f0e797f1c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1d431e-45b4-4aed-af97-3e5f830c4a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1d431e-45b4-4aed-af97-3e5f830c4a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841134617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e540fe4-5776-4734-89a6-c17db4f75fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c532c911-9999-4393-8bad-3e56fd7dabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c532c911-9999-4393-8bad-3e56fd7dabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a98f4-c7a8-4e79-aad7-df324dc9b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a98f4-c7a8-4e79-aad7-df324dc9b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e540fe4-5776-4734-89a6-c17db4f75fc2', 'volume_name': 'volume-8e540fe4-5776-4734-89a6-c17db4f75fc2', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9b100d-141d-497d-90b0-b8646fcc1a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9b100d-141d-497d-90b0-b8646fcc1a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de8d078-340a-4c25-8702-6eb6e84e86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume 8e540fe4-5776-4734-89a6-c17db4f75fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e540fe4-5776-4734-89a6-c17db4f75fc2', 'volume_size': 1} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:30 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a 1073741824" returned: 0 in 0.505s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:30 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a Sep 02 16:34:30 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:30 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a" returned: 0 in 0.312s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131206809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98423288-4053-4cfe-9638-dcd4a68a9347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume 98423288-4053-4cfe-9638-dcd4a68a9347 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70894e-84a0-4f44-8410-92a47f08764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbd2c55-baef-419d-8034-3fee04614a5a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed74c2-1237-4957-a4f4-3bdb58ed19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:30 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 1073741824 Sep 02 16:34:30 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-ebbd2c55-baef-419d-8034-3fee04614a5a (ebbd2c55-baef-419d-8034-3fee04614a5a): created successfully Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed74c2-1237-4957-a4f4-3bdb58ed19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (8874743a-ca0c-48b8-9911-f5fc8445a205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:30 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-59d25e3c-c7ce-4bfd-ac04-d9ef194b7940 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:31 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 1073741824" returned: 0 in 0.456s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:31 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 Sep 02 16:34:31 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:31 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347" returned: 0 in 0.339s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362657451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21fbe58-b890-4a6c-b5c3-32d20db86f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume a21fbe58-b890-4a6c-b5c3-32d20db86f44 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:31 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:31 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 1073741824 Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a19a58-71d0-45ba-a56d-53940e2c4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98423288-4053-4cfe-9638-dcd4a68a9347', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:31 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cdf2c5-283b-4216-b5a9-ab6f8eee8c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-98423288-4053-4cfe-9638-dcd4a68a9347 (98423288-4053-4cfe-9638-dcd4a68a9347): created successfully Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cdf2c5-283b-4216-b5a9-ab6f8eee8c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (8b7ae152-fa77-41e8-9559-bc981ce9a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-acf5f91c-00ab-493e-89b8-56bda919d6ca tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:32 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 1073741824" returned: 0 in 0.443s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:32 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 Sep 02 16:34:32 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:32 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841134617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e540fe4-5776-4734-89a6-c17db4f75fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b84bbf28ddc48c38a8b475529ad9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:30Z,use_quota=True,user_id='f784bff4069247599923cb6ffdeeb683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Creating volume 8e540fe4-5776-4734-89a6-c17db4f75fc2 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:32 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:32 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 1073741824 Sep 02 16:34:32 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35c2533-ce84-43fa-9204-a9853de19f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701dd727-446b-4bc9-810e-f0f5a605faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:32 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 (a21fbe58-b890-4a6c-b5c3-32d20db86f44): created successfully Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701dd727-446b-4bc9-810e-f0f5a605faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9446ecde-8d85-4e83-8d13-3a8d4f441531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8694aa61-7d4d-46b7-a516-61df6534fc08 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:32 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 1073741824" returned: 0 in 0.484s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:33 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 Sep 02 16:34:33 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:33 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de8d078-340a-4c25-8702-6eb6e84e86ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e540fe4-5776-4734-89a6-c17db4f75fc2', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0222cae-f828-453d-b92f-d11fffaae55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:33 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Volume volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 (8e540fe4-5776-4734-89a6-c17db4f75fc2): created successfully Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0222cae-f828-453d-b92f-d11fffaae55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Flow 'volume_create_manager' (9536cc19-9870-4916-aed7-3f0e797f1c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0485d2b1-d8a2-41dd-b174-fa3f3eb62720 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created volume successfully. Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-8e540fe4-5776-4734-89a6-c17db4f75fc2-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-8e540fe4-5776-4734-89a6-c17db4f75fc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-8e540fe4-5776-4734-89a6-c17db4f75fc2" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-8e540fe4-5776-4734-89a6-c17db4f75fc2" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e17ef7-12f1-4848-a11c-ebfea87b3d91]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:34 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 Sep 02 16:34:34 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:34 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2" returned: 0 in 0.375s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:34 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2 Sep 02 16:34:34 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:34 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8e540fe4-5776-4734-89a6-c17db4f75fc2" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-8e540fe4-5776-4734-89a6-c17db4f75fc2" released by "delete_volume" :: held 0.669s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['c5b04501-7f87-4788-86ff-4a012f376665', '1958fa00-1ebb-4951-b8c5-cbc9b877ec2f', '0b39df02-7c76-492c-92ed-d492f856cde0', 'e4b6ae5d-84c1-49a7-9046-6c83d2cd42de'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:34 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:34 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:35 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-427c9313-1689-4c54-afa4-6c9e2ac14fec tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-8e540fe4-5776-4734-89a6-c17db4f75fc2-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-a21fbe58-b890-4a6c-b5c3-32d20db86f44-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-a21fbe58-b890-4a6c-b5c3-32d20db86f44-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-a21fbe58-b890-4a6c-b5c3-32d20db86f44" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-a21fbe58-b890-4a6c-b5c3-32d20db86f44" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f1755-2644-42dd-826c-d7ba294fe574]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:35 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 Sep 02 16:34:35 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:35 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44" returned: 0 in 0.395s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:35 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44 Sep 02 16:34:35 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:35 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a21fbe58-b890-4a6c-b5c3-32d20db86f44" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-a21fbe58-b890-4a6c-b5c3-32d20db86f44" released by "delete_volume" :: held 0.725s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:35 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['c1e77492-6ba4-4e9c-b1d3-e6555a29311e', '4010b1f2-d073-4793-9084-b2856e65b6fb', 'bd379809-2dde-40b9-b2c9-c34408ecfb2a', '4e049095-377a-4df5-8ec3-7ef68c598e47'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:36 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:36 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-98423288-4053-4cfe-9638-dcd4a68a9347-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:36 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-98423288-4053-4cfe-9638-dcd4a68a9347-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c00a2ef2-d202-4cc2-97a5-babc906d0c09 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-a21fbe58-b890-4a6c-b5c3-32d20db86f44-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-98423288-4053-4cfe-9638-dcd4a68a9347" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-98423288-4053-4cfe-9638-dcd4a68a9347" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc28d6-a75c-4c62-a2be-7ced063ebca5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:36 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 Sep 02 16:34:36 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:36 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347" returned: 0 in 0.381s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:36 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347 Sep 02 16:34:36 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:37 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-98423288-4053-4cfe-9638-dcd4a68a9347" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-98423288-4053-4cfe-9638-dcd4a68a9347" released by "delete_volume" :: held 0.673s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['2053a718-fea2-4f45-8da9-f3eddf548bfa', '327e9402-d24a-432d-ba27-ceea01cd1037', '298f5383-7a93-4b27-b8c7-060552822c65', '0017d4f1-5070-4a8a-a360-3bb65ef36530'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:37 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:37 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:37 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-ebbd2c55-baef-419d-8034-3fee04614a5a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bdfa04bf-67cf-4e9a-8121-8e50e509d840 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-98423288-4053-4cfe-9638-dcd4a68a9347-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-ebbd2c55-baef-419d-8034-3fee04614a5a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-ebbd2c55-baef-419d-8034-3fee04614a5a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-ebbd2c55-baef-419d-8034-3fee04614a5a" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e84c5a-d28b-4737-8c9e-f74c4be34faf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:37 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a Sep 02 16:34:37 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:38 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:38 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a Sep 02 16:34:38 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:38 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ebbd2c55-baef-419d-8034-3fee04614a5a" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-ebbd2c55-baef-419d-8034-3fee04614a5a" released by "delete_volume" :: held 0.687s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['4bac3f5e-10b7-4e82-bf15-9e51de6a9537', '6d59a129-8fc2-42f1-a701-be440bf73326', '97660ae1-dbb5-472f-90ef-dc0a7e1b141d', '1c60ed8e-a722-4e44-9304-dc5b94037d2f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:38 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:38 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:38 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.274s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-305a6851-4162-4455-aaf0-098e77e16e0a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aaadb846-d6e3-4191-b19f-5912f4dd223d tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-ebbd2c55-baef-419d-8034-3fee04614a5a-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-305a6851-4162-4455-aaf0-098e77e16e0a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-305a6851-4162-4455-aaf0-098e77e16e0a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-305a6851-4162-4455-aaf0-098e77e16e0a" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c88b90-b79b-4a09-ad16-e2410094aff0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:38 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a Sep 02 16:34:38 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:39 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:39 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a Sep 02 16:34:39 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:39 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-305a6851-4162-4455-aaf0-098e77e16e0a" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-305a6851-4162-4455-aaf0-098e77e16e0a" released by "delete_volume" :: held 0.660s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['5621e400-c2c9-40ef-98db-1df53eaafd5f', 'f766e599-0e62-4568-89e9-d9a76cda02fa', '8be8e35b-4560-4a8e-b3ed-3a15c56c04da', '4c37c05c-9ec2-4246-9832-4152d9be830c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:39 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:39 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:39 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8d9dcd13-7195-4582-ad68-9813767eb671 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-305a6851-4162-4455-aaf0-098e77e16e0a-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-066d0746-29cf-4f01-8185-9380810f280a-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-066d0746-29cf-4f01-8185-9380810f280a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-066d0746-29cf-4f01-8185-9380810f280a" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-066d0746-29cf-4f01-8185-9380810f280a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleting offline snapshot 066d0746-29cf-4f01-8185-9380810f280a of volume 6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] snapshot_file for this snap is: volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c049271-4cea-49b6-b5e5-aeada12f404d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:40 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a Sep 02 16:34:40 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:40 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db90cd-f083-4fd7-bbf1-23a4667e2c39]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:40 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 Sep 02 16:34:40 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:40 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8" returned: 0 in 0.396s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:40 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a Sep 02 16:34:40 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:41 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a" returned: 0 in 0.352s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:41 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a Sep 02 16:34:41 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:41 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8.066d0746-29cf-4f01-8185-9380810f280a" returned: 0 in 0.241s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-066d0746-29cf-4f01-8185-9380810f280a" released by "_delete_snapshot" :: held 1.487s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" released by "delete_snapshot" :: held 1.516s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['5d492cf8-ec64-4541-b4d6-8812ad2c594f', '7781f1a9-ce2b-455e-b02a-4a90f0bdeec1', '17a6bcf2-8f19-4a9d-8c48-c1572e5de60a', 'b73ce7a2-1d6c-4d1f-877a-800464ec436e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Delete snapshot completed successfully. Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b91d51a4-043e-4ba1-a829-df01e3fbbb92 tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-066d0746-29cf-4f01-8185-9380810f280a-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Flow 'volume_create_manager' (5b3ebfda-9984-479d-a8da-3e3531d7c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da7b69-8067-44b5-8a82-796f16a3b2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da7b69-8067-44b5-8a82-796f16a3b2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e908a315-ed34-43c3-bb19-67a7cf7c152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb24933e0a4ac9937e5c85140be135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:42Z,use_quota=True,user_id='97954c028e7a4c14a421d5f7fc34399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3b9fe4-5a20-417b-beed-afd958dcf03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3b9fe4-5a20-417b-beed-afd958dcf03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2612f2-48eb-4cbe-8b55-eb7d3074f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:41 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-6e3fd02e-551e-430c-aff4-5a2a353efdd8-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-6e3fd02e-551e-430c-aff4-5a2a353efdd8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d10c20-6160-45fd-8d9e-9e0204d10e8e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2612f2-48eb-4cbe-8b55-eb7d3074f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e908a315-ed34-43c3-bb19-67a7cf7c152a', 'volume_name': 'volume-e908a315-ed34-43c3-bb19-67a7cf7c152a', 'volume_size': 1, 'image_id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5949bf88f7aa3e455f908c3d2970a372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cddb24933e0a4ac9937e5c85140be135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8de1c79d1eba6c3edee6fd193d5b48098efc423bb1248f55582e2b7eb6a9bd436d6b9c189ab86a08daf8e4a19eb005d79dbcee663d229d7dbf4330ed75daa85f', 'id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'created_at': datetime.datetime(2026, 9, 2, 14, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 34, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/425e3ae5-ce98-428a-a152-c34c3849d751/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041a0c6-2a13-4cf9-8607-a5d37f54f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041a0c6-2a13-4cf9-8607-a5d37f54f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2190a194-06d5-42f0-a6b7-8e51dea3c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Volume e908a315-ed34-43c3-bb19-67a7cf7c152a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e908a315-ed34-43c3-bb19-67a7cf7c152a', 'volume_size': 1, 'image_id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5949bf88f7aa3e455f908c3d2970a372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cddb24933e0a4ac9937e5c85140be135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8de1c79d1eba6c3edee6fd193d5b48098efc423bb1248f55582e2b7eb6a9bd436d6b9c189ab86a08daf8e4a19eb005d79dbcee663d229d7dbf4330ed75daa85f', 'id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'created_at': datetime.datetime(2026, 9, 2, 14, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 34, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/425e3ae5-ce98-428a-a152-c34c3849d751/file', 'properties': {}}, 'image_service': } Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Trying to clone e908a315-ed34-43c3-bb19-67a7cf7c152a from image 425e3ae5-ce98-428a-a152-c34c3849d751 at location (None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:34:42 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 Sep 02 16:34:42 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:34:42 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Image download 0.00 MB at 0.00 MB/s Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd26fe-173c-49ab-9065-a15364e85449]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:42 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:42 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:42 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8" returned: 0 in 0.370s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:42 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8 Sep 02 16:34:42 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:42 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:42 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e3fd02e-551e-430c-aff4-5a2a353efdd8" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-quobyte-6e3fd02e-551e-430c-aff4-5a2a353efdd8" released by "delete_volume" :: held 0.710s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:42 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:42 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Created reservations ['4870003a-cd46-4133-bf26-e374c9f971b8', 'b2934006-8d34-496f-b181-58b840f64d53', '79792d9f-5e8a-46df-8e96-19ef11d83703', '7090ca70-875b-4a4b-a83a-16a6c6619587'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:43 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:43 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:43 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Temporary image 425e3ae5-ce98-428a-a152-c34c3849d751 is fetched for user 97954c028e7a4c14a421d5f7fc34399f. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1736a3d1-1ee0-4a31-b0cf-1044cd21e89e]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:43 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.245s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:43 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Deleted volume successfully. Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-04c09633-23aa-412f-b061-4e472261462b tempest-CreateVolumesFromSnapshotTest-2030455878 None] Lock "cinder-6e3fd02e-551e-430c-aff4-5a2a353efdd8-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:43 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:43 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:43 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:43 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:43 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:43 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e908a315-ed34-43c3-bb19-67a7cf7c152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb24933e0a4ac9937e5c85140be135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:42Z,use_quota=True,user_id='97954c028e7a4c14a421d5f7fc34399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Creating volume e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:43 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:43 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1073741824 Sep 02 16:34:43 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:44 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1073741824" returned: 0 in 0.448s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:44 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a Sep 02 16:34:44 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:44 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Attempting download of 425e3ae5-ce98-428a-a152-c34c3849d751 ((None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}])) to volume e908a315-ed34-43c3-bb19-67a7cf7c152a. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3634c-4d9e-4bac-91e7-3594667b8539]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:44 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7 Sep 02 16:34:44 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:45 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7" returned: 0 in 0.347s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7 Sep 02 16:34:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:45 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7" returned: 1 in 0.319s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_425e3ae5-ce98-428a-a152-c34c3849d751_4re832i7' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec1bc4e-e7f8-49e6-b14a-f6d3eb8e3a94]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:45 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:45 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:45 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:45 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD Sep 02 16:34:45 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:46 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] 425e3ae5-ce98-428a-a152-c34c3849d751 was raw, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:46 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a Sep 02 16:34:46 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:46 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a" returned: 0 in 0.458s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_425e3ae5-ce98-428a-a152-c34c3849d751_yfyxkaipdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:34:46 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:46 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1G Sep 02 16:34:46 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:46 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a 1G" returned: 0 in 0.331s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Downloaded image 425e3ae5-ce98-428a-a152-c34c3849d751 ((None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}])) to volume e908a315-ed34-43c3-bb19-67a7cf7c152a successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Temporary image 425e3ae5-ce98-428a-a152-c34c3849d751 for user 97954c028e7a4c14a421d5f7fc34399f is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Marking volume e908a315-ed34-43c3-bb19-67a7cf7c152a as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Copying metadata from image 425e3ae5-ce98-428a-a152-c34c3849d751 to e908a315-ed34-43c3-bb19-67a7cf7c152a. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Creating volume glance metadata for volume e908a315-ed34-43c3-bb19-67a7cf7c152a backed by image 425e3ae5-ce98-428a-a152-c34c3849d751 with: {'image_id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5949bf88f7aa3e455f908c3d2970a372', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2190a194-06d5-42f0-a6b7-8e51dea3c23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e908a315-ed34-43c3-bb19-67a7cf7c152a', 'volume_size': 1, 'image_id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/425e3ae5-ce98-428a-a152-c34c3849d751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5949bf88f7aa3e455f908c3d2970a372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cddb24933e0a4ac9937e5c85140be135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8de1c79d1eba6c3edee6fd193d5b48098efc423bb1248f55582e2b7eb6a9bd436d6b9c189ab86a08daf8e4a19eb005d79dbcee663d229d7dbf4330ed75daa85f', 'id': '425e3ae5-ce98-428a-a152-c34c3849d751', 'created_at': datetime.datetime(2026, 9, 2, 14, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 34, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/425e3ae5-ce98-428a-a152-c34c3849d751/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3ecb1-f667-4232-be3c-726f17b9b067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:46 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Volume volume-e908a315-ed34-43c3-bb19-67a7cf7c152a (e908a315-ed34-43c3-bb19-67a7cf7c152a): created successfully Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3ecb1-f667-4232-be3c-726f17b9b067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:46 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Flow 'volume_create_manager' (5b3ebfda-9984-479d-a8da-3e3531d7c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-97c7318a-13ce-481c-8b22-e33c07447182 tempest-VolumeImageDependencyTests-1652690305 None] Created volume successfully. Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (1afc3020-c819-4cb8-8594-7d6cf0f8fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e9043b-51d2-4f49-8c61-53ee0c373919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e9043b-51d2-4f49-8c61-53ee0c373919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880710579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d7d849-8bb8-4534-afcc-1d7576543e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:47Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137e3e55-741b-4743-8da7-039f23e55875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137e3e55-741b-4743-8da7-039f23e55875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2415b21-c96b-438a-a5b0-a3d19c7309e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2415b21-c96b-438a-a5b0-a3d19c7309e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d7d849-8bb8-4534-afcc-1d7576543e92', 'volume_name': 'volume-34d7d849-8bb8-4534-afcc-1d7576543e92', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c9391-22a0-4260-96ba-e52f261017db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c9391-22a0-4260-96ba-e52f261017db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ae58b7-f6c3-4f90-93a9-dcc615a474cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Volume 34d7d849-8bb8-4534-afcc-1d7576543e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d7d849-8bb8-4534-afcc-1d7576543e92', 'volume_size': 1} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880710579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d7d849-8bb8-4534-afcc-1d7576543e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:47Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Creating volume 34d7d849-8bb8-4534-afcc-1d7576543e92 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:47 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:47 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 1073741824 Sep 02 16:34:47 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Acquiring lock "cinder-e908a315-ed34-43c3-bb19-67a7cf7c152a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "cinder-e908a315-ed34-43c3-bb19-67a7cf7c152a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Acquiring lock "cinder-quobyte-e908a315-ed34-43c3-bb19-67a7cf7c152a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "cinder-quobyte-e908a315-ed34-43c3-bb19-67a7cf7c152a" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c48266-f115-4032-a6ef-3c4e485e265f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:47 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a Sep 02 16:34:47 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:47 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 1073741824" returned: 0 in 0.431s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:47 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 Sep 02 16:34:47 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:47 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a" returned: 0 in 0.372s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:47 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a Sep 02 16:34:47 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:47 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ae58b7-f6c3-4f90-93a9-dcc615a474cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d7d849-8bb8-4534-afcc-1d7576543e92', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557d2f2e-17fb-4d01-88b0-2541e222e5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Volume volume-34d7d849-8bb8-4534-afcc-1d7576543e92 (34d7d849-8bb8-4534-afcc-1d7576543e92): created successfully Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557d2f2e-17fb-4d01-88b0-2541e222e5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (1afc3020-c819-4cb8-8594-7d6cf0f8fb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a827c5c1-a468-48a8-a9db-923c4d3a3ecf tempest-ProjectReaderTests-1943369218 None] Created volume successfully. Sep 02 16:34:48 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e908a315-ed34-43c3-bb19-67a7cf7c152a" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "cinder-quobyte-e908a315-ed34-43c3-bb19-67a7cf7c152a" released by "delete_volume" :: held 0.689s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Created reservations ['604d8d47-820e-419d-acde-174f0c3e2747', '11a98407-81da-4472-b44d-957dd99e5319', 'a93805a7-83b2-4117-982c-4b0c0fb106c4', '444ac447-a604-4e13-85c6-bb8e987a686f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:48 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:48 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-34d7d849-8bb8-4534-afcc-1d7576543e92-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-34d7d849-8bb8-4534-afcc-1d7576543e92-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-quobyte-34d7d849-8bb8-4534-afcc-1d7576543e92" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-34d7d849-8bb8-4534-afcc-1d7576543e92" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158f9c4-1c11-4515-a8e6-593b3aa6cfc9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:48 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.284s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Deleted volume successfully. Sep 02 16:34:48 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 Sep 02 16:34:48 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-82558c71-92fc-44ad-9562-956bf75ec76b tempest-VolumeImageDependencyTests-1652690305 None] Lock "cinder-e908a315-ed34-43c3-bb19-67a7cf7c152a-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:48 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:48 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:48 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92" returned: 0 in 0.381s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:48 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92 Sep 02 16:34:48 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:48 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:34:48 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-34d7d849-8bb8-4534-afcc-1d7576543e92" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-34d7d849-8bb8-4534-afcc-1d7576543e92" released by "delete_volume" :: held 0.687s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Created reservations ['a8cacbd9-633e-4f38-b7ec-d8eacd284885', 'f04e4246-fbcf-4692-924f-6633a221defb', '536830b6-9b8a-4e5b-8c69-f94138afd01f', '9cdd83e0-cd67-4b55-beb4-9637776b9308'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:49 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:49 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:49 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:49 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Deleted volume successfully. Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b343945c-f881-4f66-9574-a77494019c18 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-34d7d849-8bb8-4534-afcc-1d7576543e92-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (b5ae94c5-1b55-4608-923f-99d4ea37176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0020be-5986-41d2-9e91-716874681295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0020be-5986-41d2-9e91-716874681295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087354202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf429b-ebb1-4e5e-949e-68ab0ee3db90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:50Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff2896-875c-45ca-b2c6-08a1b935cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff2896-875c-45ca-b2c6-08a1b935cd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c3283d-b4cf-405d-a774-07d79ceace90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c3283d-b4cf-405d-a774-07d79ceace90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcf429b-ebb1-4e5e-949e-68ab0ee3db90', 'volume_name': 'volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1500a7f7-487d-43e8-bf40-03e739e1ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1500a7f7-487d-43e8-bf40-03e739e1ac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45e50a1-4c83-47da-aced-fd601486aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:49 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Volume 3fcf429b-ebb1-4e5e-949e-68ab0ee3db90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90', 'volume_size': 1} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087354202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf429b-ebb1-4e5e-949e-68ab0ee3db90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:50Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Creating volume 3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:49 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:50 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 1073741824 Sep 02 16:34:50 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:50 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 1073741824" returned: 0 in 0.466s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:50 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 Sep 02 16:34:50 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:50 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45e50a1-4c83-47da-aced-fd601486aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf61806-6800-413b-9e32-50e658f44d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:50 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Volume volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 (3fcf429b-ebb1-4e5e-949e-68ab0ee3db90): created successfully Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf61806-6800-413b-9e32-50e658f44d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:50 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (b5ae94c5-1b55-4608-923f-99d4ea37176d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:50 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9ff0aa6b-4b32-4481-8c7f-d40a0f219982 tempest-ProjectReaderTests-1943369218 None] Created volume successfully. Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "cinder-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-quobyte-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[539dbba5-d928-4172-b992-eb133e2180d8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:52 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 Sep 02 16:34:52 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:52 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:52 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90 Sep 02 16:34:52 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:52 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" returned: 0 in 0.246s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90" released by "delete_volume" :: held 0.681s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Created reservations ['18d75c1d-f621-4a4e-8b75-c102dabbbe80', 'a34a3d0b-4814-4faf-9adc-22344f1c825b', '45fd8233-9f88-4e7d-8821-1ddae901f25f', '50bbc121-85ac-430a-b1ec-a1f54126d1b6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:52 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:52 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:53 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:53 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Deleted volume successfully. Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4f5b7ba-ad32-46bd-a594-4759b04fb9ea tempest-ProjectReaderTests-1943369218 None] Lock "cinder-3fcf429b-ebb1-4e5e-949e-68ab0ee3db90-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (68f4b3c9-2212-4e99-89c6-b46bb2725361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545c9ea-15cb-457b-9cfe-7128aa9e2275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545c9ea-15cb-457b-9cfe-7128aa9e2275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990443996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf53781-5e76-4b99-9ab7-44726737d42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:54Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da143ec-a6dc-428b-8705-4d626248622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da143ec-a6dc-428b-8705-4d626248622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee5988f-8f76-45e0-9a41-1d74de8f80ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee5988f-8f76-45e0-9a41-1d74de8f80ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf53781-5e76-4b99-9ab7-44726737d42f', 'volume_name': 'volume-0bf53781-5e76-4b99-9ab7-44726737d42f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ee3a2e-3597-456c-b493-186828e8e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ee3a2e-3597-456c-b493-186828e8e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e9570d-df20-4446-a0a0-9f41685371eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:53 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Volume 0bf53781-5e76-4b99-9ab7-44726737d42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf53781-5e76-4b99-9ab7-44726737d42f', 'volume_size': 1} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990443996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf53781-5e76-4b99-9ab7-44726737d42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:54Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Creating volume 0bf53781-5e76-4b99-9ab7-44726737d42f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:53 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:53 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f 1073741824 Sep 02 16:34:53 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:54 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f 1073741824" returned: 0 in 0.474s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:54 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f Sep 02 16:34:54 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:54 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f" returned: 0 in 0.241s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e9570d-df20-4446-a0a0-9f41685371eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf53781-5e76-4b99-9ab7-44726737d42f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab49af-6f25-45c9-89ec-faee7cc39a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:54 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Volume volume-0bf53781-5e76-4b99-9ab7-44726737d42f (0bf53781-5e76-4b99-9ab7-44726737d42f): created successfully Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab49af-6f25-45c9-89ec-faee7cc39a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (68f4b3c9-2212-4e99-89c6-b46bb2725361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-65abd0bd-6ff5-4250-9ee7-574eaac68bc9 tempest-ProjectReaderTests-1943369218 None] Created volume successfully. Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-0bf53781-5e76-4b99-9ab7-44726737d42f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "cinder-0bf53781-5e76-4b99-9ab7-44726737d42f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-quobyte-0bf53781-5e76-4b99-9ab7-44726737d42f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-0bf53781-5e76-4b99-9ab7-44726737d42f" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b6a9a-ccf6-4d38-aaad-f8e7ff11e6f7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:54 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f Sep 02 16:34:54 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:55 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f" returned: 0 in 0.355s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:55 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f Sep 02 16:34:55 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:55 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0bf53781-5e76-4b99-9ab7-44726737d42f" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-0bf53781-5e76-4b99-9ab7-44726737d42f" released by "delete_volume" :: held 0.675s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Created reservations ['a1366d8d-6bbe-4d9e-af44-8871db416f2f', '0c7e3a15-bd5c-488e-8182-b6d1a734b17c', '9bc9898d-49ec-4bc7-b6fc-aa45938f931a', '2b381122-6339-459a-814b-c9445a8a072f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:55 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:55 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:55 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:55 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Deleted volume successfully. Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2f4c4ef5-ae6a-46e7-a743-29bd66e8f01c tempest-ProjectReaderTests-1943369218 None] Lock "cinder-0bf53781-5e76-4b99-9ab7-44726737d42f-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (62d427b5-41ba-4048-b52d-4d5c74426631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96981ddd-8a7b-4c91-9a45-3736b145af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96981ddd-8a7b-4c91-9a45-3736b145af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699291669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abbe843-d9b5-4272-bb98-10216776e48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:56Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcf381-e12d-4044-bac4-7713feaaeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcf381-e12d-4044-bac4-7713feaaeb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed0d93-a59a-4894-81fa-1f4403ea13f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed0d93-a59a-4894-81fa-1f4403ea13f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abbe843-d9b5-4272-bb98-10216776e48f', 'volume_name': 'volume-2abbe843-d9b5-4272-bb98-10216776e48f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5337b84d-8e17-4b53-9ff5-13de05df670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5337b84d-8e17-4b53-9ff5-13de05df670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3880402f-ea0d-44a7-a6c0-cb3f4bbbcfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Volume 2abbe843-d9b5-4272-bb98-10216776e48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abbe843-d9b5-4272-bb98-10216776e48f', 'volume_size': 1} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699291669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abbe843-d9b5-4272-bb98-10216776e48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb11596c0ec84e759de37d71ac5c00c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:34:56Z,use_quota=True,user_id='39fff4fa4bd64e518317e6928ffd8522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Creating volume 2abbe843-d9b5-4272-bb98-10216776e48f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:34:56 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:56 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f 1073741824 Sep 02 16:34:56 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:56 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f 1073741824" returned: 0 in 0.456s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:57 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f Sep 02 16:34:57 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:57 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3880402f-ea0d-44a7-a6c0-cb3f4bbbcfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abbe843-d9b5-4272-bb98-10216776e48f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46938d4b-a32f-4aa4-a005-7b8963ca8504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:34:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Volume volume-2abbe843-d9b5-4272-bb98-10216776e48f (2abbe843-d9b5-4272-bb98-10216776e48f): created successfully Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46938d4b-a32f-4aa4-a005-7b8963ca8504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Flow 'volume_create_manager' (62d427b5-41ba-4048-b52d-4d5c74426631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:34:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-761830b0-92e4-44da-8680-228b90f9cc92 tempest-ProjectReaderTests-1943369218 None] Created volume successfully. Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-2abbe843-d9b5-4272-bb98-10216776e48f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-2abbe843-d9b5-4272-bb98-10216776e48f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "cinder-quobyte-2abbe843-d9b5-4272-bb98-10216776e48f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-2abbe843-d9b5-4272-bb98-10216776e48f" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff16ba3-1b51-4c19-b61b-02d36075baef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:57 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f Sep 02 16:34:57 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:57 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:57 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f Sep 02 16:34:57 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:58 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2abbe843-d9b5-4272-bb98-10216776e48f" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-quobyte-2abbe843-d9b5-4272-bb98-10216776e48f" released by "delete_volume" :: held 0.674s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Created reservations ['6e254a91-3a84-461b-b974-3238ada41a17', '1cfe7030-9cff-4b97-b18d-78468fb523f2', '12934658-5aca-45fc-a615-0dddda588af6', '73f5d5f5-2e95-4fd5-b35b-e1e47e36654c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:34:58 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:34:58 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:34:58 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:34:58 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Deleted volume successfully. Sep 02 16:34:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-10b79d70-01f4-4f54-ae5c-fb88f4881d02 tempest-ProjectReaderTests-1943369218 None] Lock "cinder-2abbe843-d9b5-4272-bb98-10216776e48f-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=97,cinder:UPDATE=126,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:35:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=96,cinder:UPDATE=150,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (14841799-b4f4-48a6-9c2f-0c7adb33bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b09738-37bb-4805-b033-9061f10ba882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b09738-37bb-4805-b033-9061f10ba882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874480902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486d9d3c-834d-4cd7-9af6-0e06af24659e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e82589-1b31-4c59-813a-6162584f6a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e82589-1b31-4c59-813a-6162584f6a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55ee19-ed5a-49b4-8df7-9d285258648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55ee19-ed5a-49b4-8df7-9d285258648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486d9d3c-834d-4cd7-9af6-0e06af24659e', 'volume_name': 'volume-486d9d3c-834d-4cd7-9af6-0e06af24659e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becd6d2-e1cf-4780-9908-d6013a1277f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becd6d2-e1cf-4780-9908-d6013a1277f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e526572-3aa8-4adb-a208-2774dd69250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:10 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume 486d9d3c-834d-4cd7-9af6-0e06af24659e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486d9d3c-834d-4cd7-9af6-0e06af24659e', 'volume_size': 1} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874480902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486d9d3c-834d-4cd7-9af6-0e06af24659e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume 486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:10 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:10 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e 1073741824 Sep 02 16:35:10 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (5b2a6651-ebfc-43fa-922c-a45d0512ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:10 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077f3750-6654-46b2-8f7a-d6dcc692d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077f3750-6654-46b2-8f7a-d6dcc692d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580525670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daca423-86b9-45b8-85a6-92f7e3407d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00987ec-6d5d-44c3-ae84-f2176cbb205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00987ec-6d5d-44c3-ae84-f2176cbb205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c5ac7-40d1-420b-aa5e-cbf1d3936c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c5ac7-40d1-420b-aa5e-cbf1d3936c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0daca423-86b9-45b8-85a6-92f7e3407d8f', 'volume_name': 'volume-0daca423-86b9-45b8-85a6-92f7e3407d8f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fefcdf-a3f3-4397-afb5-121a2f881ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fefcdf-a3f3-4397-afb5-121a2f881ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceb7244-0689-4812-a9f4-aeab4fb4ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume 0daca423-86b9-45b8-85a6-92f7e3407d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0daca423-86b9-45b8-85a6-92f7e3407d8f', 'volume_size': 1} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:11 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e 1073741824" returned: 0 in 0.526s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:11 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e Sep 02 16:35:11 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (36c064bf-6d3d-47cd-a444-59240e7d174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4977e6-1c49-4fc9-9d6a-71073611446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4977e6-1c49-4fc9-9d6a-71073611446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658763247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78077fb9-4066-415f-847e-f204f06efcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c55a9bf-ac88-4a8c-962a-ccce723ebd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c55a9bf-ac88-4a8c-962a-ccce723ebd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979b2880-571d-44b4-a1ab-182ab7c6c8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979b2880-571d-44b4-a1ab-182ab7c6c8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78077fb9-4066-415f-847e-f204f06efcf9', 'volume_name': 'volume-78077fb9-4066-415f-847e-f204f06efcf9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1700b28f-2d9e-4464-b79f-627b84c3cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1700b28f-2d9e-4464-b79f-627b84c3cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f0237-1196-41f7-bf94-1528191b3097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Volume 78077fb9-4066-415f-847e-f204f06efcf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78077fb9-4066-415f-847e-f204f06efcf9', 'volume_size': 1} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:11 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e" returned: 0 in 0.297s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580525670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daca423-86b9-45b8-85a6-92f7e3407d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume 0daca423-86b9-45b8-85a6-92f7e3407d8f {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:11 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e526572-3aa8-4adb-a208-2774dd69250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486d9d3c-834d-4cd7-9af6-0e06af24659e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f 1073741824 Sep 02 16:35:11 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38a572-ba1a-4eed-be88-8d1e06d1057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:11 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-486d9d3c-834d-4cd7-9af6-0e06af24659e (486d9d3c-834d-4cd7-9af6-0e06af24659e): created successfully Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38a572-ba1a-4eed-be88-8d1e06d1057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:11 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (14841799-b4f4-48a6-9c2f-0c7adb33bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-062d4e03-96e1-40e3-ae29-8b2bb696b953 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:12 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f 1073741824" returned: 0 in 0.437s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:12 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f Sep 02 16:35:12 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:12 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658763247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78077fb9-4066-415f-847e-f204f06efcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:11Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Creating volume 78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:12 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:12 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 1073741824 Sep 02 16:35:12 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceb7244-0689-4812-a9f4-aeab4fb4ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0daca423-86b9-45b8-85a6-92f7e3407d8f', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450fc85-6a00-4511-b2c0-9b97402b66d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-0daca423-86b9-45b8-85a6-92f7e3407d8f (0daca423-86b9-45b8-85a6-92f7e3407d8f): created successfully Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450fc85-6a00-4511-b2c0-9b97402b66d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (5b2a6651-ebfc-43fa-922c-a45d0512ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6c6b32ab-5ca3-4a57-a4e1-5e8e668359a1 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:13 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 1073741824" returned: 0 in 0.567s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:13 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 Sep 02 16:35:13 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:13 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.450s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (9d214804-ef60-4e5a-a09f-d253b6d6ec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68da1a2-b30c-4cdf-9df6-9fa2bbd7a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f0237-1196-41f7-bf94-1528191b3097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78077fb9-4066-415f-847e-f204f06efcf9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b334be00-bc1b-4eef-8d14-7bcc3f814664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating offline snapshot 47c7229b-cf87-4e37-a50d-5e67c637d74d of volume 486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68da1a2-b30c-4cdf-9df6-9fa2bbd7a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567387925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b7edda-7830-4e77-9241-711a3b0a7de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:13Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8061b6-8976-4220-a14e-ff229ed90348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8061b6-8976-4220-a14e-ff229ed90348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb831684-863e-4ccc-86f3-f90a1a7d1e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb831684-863e-4ccc-86f3-f90a1a7d1e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b7edda-7830-4e77-9241-711a3b0a7de1', 'volume_name': 'volume-47b7edda-7830-4e77-9241-711a3b0a7de1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc61fd3-a8fd-4457-8ce3-1bb060139a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc61fd3-a8fd-4457-8ce3-1bb060139a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e9f51f-d46d-423a-a601-11d87226d8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume 47b7edda-7830-4e77-9241-711a3b0a7de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b7edda-7830-4e77-9241-711a3b0a7de1', 'volume_size': 1} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c798775-ac73-42d8-aae5-0498521534ae]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Volume volume-78077fb9-4066-415f-847e-f204f06efcf9 (78077fb9-4066-415f-847e-f204f06efcf9): created successfully Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b334be00-bc1b-4eef-8d14-7bcc3f814664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (36c064bf-6d3d-47cd-a444-59240e7d174c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-95c93c42-c5ce-4738-b009-38413a336db0 tempest-ProjectReaderTests-303186967 None] Created volume successfully. Sep 02 16:35:13 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e Sep 02 16:35:13 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (c7823af9-e943-412d-9d75-262c0b5b7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1fe655-85eb-4935-8e87-a6b45077ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1fe655-85eb-4935-8e87-a6b45077ab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848746938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205dd9c9-40d4-442d-bf9b-cce3143f675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc603c09-e141-4e9f-8d1e-1aad8b80e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc603c09-e141-4e9f-8d1e-1aad8b80e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e72388c-f1de-4b74-8ae9-b8131b171bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e72388c-f1de-4b74-8ae9-b8131b171bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '205dd9c9-40d4-442d-bf9b-cce3143f675b', 'volume_name': 'volume-205dd9c9-40d4-442d-bf9b-cce3143f675b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b97f001-23ef-4906-bbba-27f4ff6aecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b97f001-23ef-4906-bbba-27f4ff6aecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41ed99e-e05f-492a-b939-4822d4ad0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume 205dd9c9-40d4-442d-bf9b-cce3143f675b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-205dd9c9-40d4-442d-bf9b-cce3143f675b', 'volume_size': 1} Sep 02 16:35:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:14 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:14 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d 1G Sep 02 16:35:14 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (fb30c78d-b408-431c-ae6b-9bc29ea6fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ed6c6a-d004-4d6d-ba94-140e48d03233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ed6c6a-d004-4d6d-ba94-140e48d03233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475164858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94b59f1-d023-451b-90f4-7f49009d1404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1148a384-d56c-4baa-b4d8-f65db2efb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1148a384-d56c-4baa-b4d8-f65db2efb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806784fe-166e-4172-b84d-c8aae8b46d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806784fe-166e-4172-b84d-c8aae8b46d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94b59f1-d023-451b-90f4-7f49009d1404', 'volume_name': 'volume-f94b59f1-d023-451b-90f4-7f49009d1404', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34aa1ef-a5b1-4a27-b996-385c0e893188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34aa1ef-a5b1-4a27-b996-385c0e893188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34353826-6602-4c35-8f7a-247f7e6659cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume f94b59f1-d023-451b-90f4-7f49009d1404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94b59f1-d023-451b-90f4-7f49009d1404', 'volume_size': 1} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:14 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Flow 'volume_create_manager' (2b24c756-c627-4d90-aef5-1dd096b68014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49e48df-988c-4e8d-a2ed-f2be91290939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d 1G" returned: 0 in 0.564s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486d9d3c-834d-4cd7-9af6-0e06af24659e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49e48df-988c-4e8d-a2ed-f2be91290939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bae8cae-3d77-45c5-bac0-cb5ea0bcda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab6d0ecc01641cba591467da54aae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='03ad4e7a1978413588af8659100b4c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b9ef4d0-adcd-4f04-b6a7-763e06da7fa1),volume_type_id=5b9ef4d0-adcd-4f04-b6a7-763e06da7fa1)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486d9d3c-834d-4cd7-9af6-0e06af24659e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d Sep 02 16:35:14 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067f7d09-0382-4738-a661-e0fb2bda6e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067f7d09-0382-4738-a661-e0fb2bda6e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81540a14-0cca-4c47-8d5d-f178ed3359bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:35:14 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (531cea87-6fd2-44c6-99c6-603fcf9d7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d47d77-4ff7-4683-974c-12ebbc2a1d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d47d77-4ff7-4683-974c-12ebbc2a1d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797793013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:15Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8416952-5590-40d3-8534-10c5ed20c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8416952-5590-40d3-8534-10c5ed20c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a64eb29-4429-4aeb-a7fd-06a708474aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a64eb29-4429-4aeb-a7fd-06a708474aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7', 'volume_name': 'volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971c83b2-2ff8-49c6-af7a-24ea2bcdfe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971c83b2-2ff8-49c6-af7a-24ea2bcdfe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9ff84b-2039-4e2c-9cb6-0327b5ea93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7', 'volume_size': 1} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486d9d3c-834d-4cd7-9af6-0e06af24659e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d" returned: 0 in 0.501s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:15 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d is being set with open permissions: ugo+rw Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:15 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d Sep 02 16:35:15 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81540a14-0cca-4c47-8d5d-f178ed3359bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bae8cae-3d77-45c5-bac0-cb5ea0bcda22', 'volume_name': 'volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22', 'volume_size': 1, 'image_id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a524b05bb48f822e69d2520c04523a93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fab6d0ecc01641cba591467da54aae6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34b64edd803aad1f8e47d7b566d32b125e486f96688d3cccfa60b4384c94136f76e30348fea97c97f06ec41ecff0acd425b623bf15480f8e965ba94bd5455fd', 'id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1038adc-6151-4ecb-8f95-ceeda5eb8782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1038adc-6151-4ecb-8f95-ceeda5eb8782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1464048-8c45-4498-a02b-bbaa4894e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22', 'volume_size': 1, 'image_id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a524b05bb48f822e69d2520c04523a93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fab6d0ecc01641cba591467da54aae6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34b64edd803aad1f8e47d7b566d32b125e486f96688d3cccfa60b4384c94136f76e30348fea97c97f06ec41ecff0acd425b623bf15480f8e965ba94bd5455fd', 'id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Trying to clone 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 from image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:35:15 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Image download 0.00 MB at 0.00 MB/s Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[29135b2d-e073-4b07-a1bc-34256c77d17a]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:15 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d" returned: 0 in 0.308s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (f039fedc-de37-4b6f-a1f3-110ecf18f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5074a519-4f58-4d54-b487-123e6127747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5074a519-4f58-4d54-b487-123e6127747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083824584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed97e2-42e4-469e-84b7-38610c733886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:15Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb5f6a2-ba1f-4af9-88eb-64b35d7d5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb5f6a2-ba1f-4af9-88eb-64b35d7d5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877cf7f-6d9a-4783-8056-2db9935fc810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877cf7f-6d9a-4783-8056-2db9935fc810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceed97e2-42e4-469e-84b7-38610c733886', 'volume_name': 'volume-ceed97e2-42e4-469e-84b7-38610c733886', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:15 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22dd03-f3e3-4fff-bcb0-5d216777242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22dd03-f3e3-4fff-bcb0-5d216777242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a689db-6f8a-437f-a85d-82d918af0cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume ceed97e2-42e4-469e-84b7-38610c733886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceed97e2-42e4-469e-84b7-38610c733886', 'volume_size': 1} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:15 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info Sep 02 16:35:15 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:15 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:15 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:15 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info is being set with open permissions: ugo+rw Sep 02 16:35:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:15 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info Sep 02 16:35:15 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:15 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:15 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:16 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.info" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:16 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567387925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b7edda-7830-4e77-9241-711a3b0a7de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:13Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume 47b7edda-7830-4e77-9241-711a3b0a7de1 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:16 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Temporary image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f is fetched for user 03ad4e7a1978413588af8659100b4c31. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:35:16 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 1073741824 Sep 02 16:35:16 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:16 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aecd62ef-69ba-496d-9673-f420c05f5cf7 tempest-CreateVolumesFromSnapshotTest-289357254 None] Create snapshot completed successfully Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a90dc-ac58-4fce-91ac-17cb4f8f283d]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:16 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:16 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:16 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:16 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 1073741824" returned: 0 in 0.559s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:16 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 Sep 02 16:35:16 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:16 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:16 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (95bab47b-0433-4410-93e7-08bc75465a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd739c83-2198-45e8-bddf-f495b70e1213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd739c83-2198-45e8-bddf-f495b70e1213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122025112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ee1c92-2598-4e97-9190-feef704a63e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9a42c9-4c86-4b8d-a93f-3745c57e2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9a42c9-4c86-4b8d-a93f-3745c57e2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0de2480-6b19-4c04-ab3d-f1fdc4701514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0de2480-6b19-4c04-ab3d-f1fdc4701514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ee1c92-2598-4e97-9190-feef704a63e6', 'volume_name': 'volume-c5ee1c92-2598-4e97-9190-feef704a63e6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7469d974-d25c-421c-bafc-8cdeed3d81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7469d974-d25c-421c-bafc-8cdeed3d81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bca8da-d3d8-4230-802a-e02750f4af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:16 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume c5ee1c92-2598-4e97-9190-feef704a63e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ee1c92-2598-4e97-9190-feef704a63e6', 'volume_size': 1} Sep 02 16:35:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:17 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:17 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1" returned: 0 in 0.338s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848746938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205dd9c9-40d4-442d-bf9b-cce3143f675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume 205dd9c9-40d4-442d-bf9b-cce3143f675b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:17 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e9f51f-d46d-423a-a601-11d87226d8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b7edda-7830-4e77-9241-711a3b0a7de1', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035524c7-eb5b-4857-945f-f4566a4ac1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b 1073741824 Sep 02 16:35:17 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-47b7edda-7830-4e77-9241-711a3b0a7de1 (47b7edda-7830-4e77-9241-711a3b0a7de1): created successfully Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035524c7-eb5b-4857-945f-f4566a4ac1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (9d214804-ef60-4e5a-a09f-d253b6d6ec0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c8c9c882-1f9a-440f-93cd-d4a4253d1f20 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (eb821f19-830a-482a-8e67-529dd3d1e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23637e8f-0891-4755-9cab-0f21bf56adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23637e8f-0891-4755-9cab-0f21bf56adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1372928319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed49e30-6271-47b0-8302-d7389f4e0183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71aa7d4-0ed5-4f9c-aa26-8f32f1f7196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71aa7d4-0ed5-4f9c-aa26-8f32f1f7196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205afe3c-bf7a-437f-a22a-9774a685a0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205afe3c-bf7a-437f-a22a-9774a685a0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed49e30-6271-47b0-8302-d7389f4e0183', 'volume_name': 'volume-8ed49e30-6271-47b0-8302-d7389f4e0183', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70615b35-6dd9-457d-ad32-6ae5e8b6194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70615b35-6dd9-457d-ad32-6ae5e8b6194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a8712d-d70d-4c89-aecd-d0ef94b4bf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume 8ed49e30-6271-47b0-8302-d7389f4e0183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed49e30-6271-47b0-8302-d7389f4e0183', 'volume_size': 1} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (1ea3ddb2-7a65-491e-a230-ee279125165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6334d00-c9fb-48a8-8b40-90e75a6e24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6334d00-c9fb-48a8-8b40-90e75a6e24ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879068825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058fd700-e82a-48d5-9c59-f1e2d158814b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55bae56-3edf-4e72-b486-8e93e3aa7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55bae56-3edf-4e72-b486-8e93e3aa7547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e0e0b0-8dba-4f54-ab66-e804aee1870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e0e0b0-8dba-4f54-ab66-e804aee1870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058fd700-e82a-48d5-9c59-f1e2d158814b', 'volume_name': 'volume-058fd700-e82a-48d5-9c59-f1e2d158814b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83133445-08e1-4356-9ca9-956e6657da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83133445-08e1-4356-9ca9-956e6657da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa7cc5-8368-44cb-95df-66caba501eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume 058fd700-e82a-48d5-9c59-f1e2d158814b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058fd700-e82a-48d5-9c59-f1e2d158814b', 'volume_size': 1} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:17 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b 1073741824" returned: 0 in 0.606s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:17 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b Sep 02 16:35:17 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (275349a3-def4-44f0-9e1d-608f79eb26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:17 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0532ebd2-9c04-44e3-9c2f-534e015ea84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b" returned: 0 in 0.287s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.551s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475164858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94b59f1-d023-451b-90f4-7f49009d1404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume f94b59f1-d023-451b-90f4-7f49009d1404 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41ed99e-e05f-492a-b939-4822d4ad0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-205dd9c9-40d4-442d-bf9b-cce3143f675b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 1073741824 Sep 02 16:35:18 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f70ea3-8113-494e-abdc-4faced359511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0532ebd2-9c04-44e3-9c2f-534e015ea84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676831947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a945c-343f-495c-bb07-20748d4ff2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:18Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebcacda-467e-4fd1-8f83-0253cd300f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebcacda-467e-4fd1-8f83-0253cd300f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c600d-f5f1-4875-9e2a-561cba4c3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c600d-f5f1-4875-9e2a-561cba4c3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324a945c-343f-495c-bb07-20748d4ff2ca', 'volume_name': 'volume-324a945c-343f-495c-bb07-20748d4ff2ca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382f5a37-bb20-4349-b187-279cf3aabf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382f5a37-bb20-4349-b187-279cf3aabf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46110d-e552-4fa5-b4ff-116702242b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume 324a945c-343f-495c-bb07-20748d4ff2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324a945c-343f-495c-bb07-20748d4ff2ca', 'volume_size': 1} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-205dd9c9-40d4-442d-bf9b-cce3143f675b (205dd9c9-40d4-442d-bf9b-cce3143f675b): created successfully Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f70ea3-8113-494e-abdc-4faced359511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (c7823af9-e943-412d-9d75-262c0b5b7695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9ce75d09-d271-4417-9268-25e30daab76b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (a2dccc74-3e74-4a90-8670-74c278c3ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4280fef-a525-44da-83f0-e700da827762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4280fef-a525-44da-83f0-e700da827762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497108486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da124fd8-a906-4d49-b722-de4f79330d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:18Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fb53c5-3256-4fcd-b023-a21f02fee991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fb53c5-3256-4fcd-b023-a21f02fee991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15a91cb-b932-4498-9aa2-1497ff870922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15a91cb-b932-4498-9aa2-1497ff870922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da124fd8-a906-4d49-b722-de4f79330d9e', 'volume_name': 'volume-da124fd8-a906-4d49-b722-de4f79330d9e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb57f369-849b-402b-952a-11c78192910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb57f369-849b-402b-952a-11c78192910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01409f0c-f236-48fb-a0f3-7393a9d0f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume da124fd8-a906-4d49-b722-de4f79330d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da124fd8-a906-4d49-b722-de4f79330d9e', 'volume_size': 1} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:18 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 1073741824" returned: 0 in 0.430s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:18 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 Sep 02 16:35:18 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:18 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.632s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797793013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:15Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34353826-6602-4c35-8f7a-247f7e6659cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94b59f1-d023-451b-90f4-7f49009d1404', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 1073741824 Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8357fca5-a6e4-42d5-ba98-74f9d5117320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:18 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-f94b59f1-d023-451b-90f4-7f49009d1404 (f94b59f1-d023-451b-90f4-7f49009d1404): created successfully Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8357fca5-a6e4-42d5-ba98-74f9d5117320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (fb30c78d-b408-431c-ae6b-9bc29ea6fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:18 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-66fa3959-0184-4dc5-a031-e1e4018304aa tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:19 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 1073741824" returned: 0 in 0.421s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:19 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 Sep 02 16:35:19 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:19 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.234s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9ff84b-2039-4e2c-9cb6-0327b5ea93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b24518-88cb-4387-8cab-7e72f09ce2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Creating offline snapshot f8cb2125-9456-4afd-9ae6-79a1c7ca7630 of volume 78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:19 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 (b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7): created successfully Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b24518-88cb-4387-8cab-7e72f09ce2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (531cea87-6fd2-44c6-99c6-603fcf9d7abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0e524c-2976-499b-8730-b7be189c7d2f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-52611953-9474-447b-8cb9-c6566f1bd01b tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:19 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 Sep 02 16:35:19 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:19 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9" returned: 0 in 0.387s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:19 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 1G Sep 02 16:35:19 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:20 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 1G" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78077fb9-4066-415f-847e-f204f06efcf9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:20 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78077fb9-4066-415f-847e-f204f06efcf9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 Sep 02 16:35:20 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:20 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78077fb9-4066-415f-847e-f204f06efcf9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630" returned: 0 in 0.285s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:20 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 is being set with open permissions: ugo+rw Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:20 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 Sep 02 16:35:20 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:20 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630" returned: 0 in 0.244s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:20 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info Sep 02 16:35:20 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:21 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info" returned: 0 in 0.244s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:21 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info is being set with open permissions: ugo+rw Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:21 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info Sep 02 16:35:21 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:21 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.info" returned: 0 in 0.239s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.856s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083824584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed97e2-42e4-469e-84b7-38610c733886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282b046ba16e45c9ad43e01058082df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:15Z,use_quota=True,user_id='f76a3209dc164b4fb41c1beafbf78e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Creating volume ceed97e2-42e4-469e-84b7-38610c733886 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:21 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:21 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 1073741824 Sep 02 16:35:21 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8dd0f230-f507-437d-aa8c-697320e05f76 tempest-ProjectReaderTests-303186967 None] Create snapshot completed successfully Sep 02 16:35:21 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 1073741824" returned: 0 in 0.437s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:21 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 Sep 02 16:35:21 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:22 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886" returned: 0 in 0.238s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.245s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122025112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ee1c92-2598-4e97-9190-feef704a63e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume c5ee1c92-2598-4e97-9190-feef704a63e6 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a689db-6f8a-437f-a85d-82d918af0cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceed97e2-42e4-469e-84b7-38610c733886', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:22 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 1073741824 Sep 02 16:35:22 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0ec64f-2f94-48a9-a89f-68a9304f1769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:22 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Volume volume-ceed97e2-42e4-469e-84b7-38610c733886 (ceed97e2-42e4-469e-84b7-38610c733886): created successfully Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0ec64f-2f94-48a9-a89f-68a9304f1769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Flow 'volume_create_manager' (f039fedc-de37-4b6f-a1f3-110ecf18f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:22 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3a80b838-ffcc-407f-b683-ff4030a6922d tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created volume successfully. Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-f8cb2125-9456-4afd-9ae6-79a1c7ca7630-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-f8cb2125-9456-4afd-9ae6-79a1c7ca7630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-f8cb2125-9456-4afd-9ae6-79a1c7ca7630" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-f8cb2125-9456-4afd-9ae6-79a1c7ca7630" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Deleting offline snapshot f8cb2125-9456-4afd-9ae6-79a1c7ca7630 of volume 78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] snapshot_file for this snap is: volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e170ed-69ae-416f-ab5f-e126e8429389]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:22 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 1073741824" returned: 0 in 0.482s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:22 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 Sep 02 16:35:22 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:22 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 Sep 02 16:35:22 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:22 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bae8cae-3d77-45c5-bac0-cb5ea0bcda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab6d0ecc01641cba591467da54aae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:14Z,use_quota=True,user_id='03ad4e7a1978413588af8659100b4c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b9ef4d0-adcd-4f04-b6a7-763e06da7fa1),volume_type_id=5b9ef4d0-adcd-4f04-b6a7-763e06da7fa1)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Creating volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:22 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:22 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1073741824 Sep 02 16:35:22 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:22 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bca8da-d3d8-4230-802a-e02750f4af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ee1c92-2598-4e97-9190-feef704a63e6', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0269986-351d-4fa5-8d9b-01df452fca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:23 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-c5ee1c92-2598-4e97-9190-feef704a63e6 (c5ee1c92-2598-4e97-9190-feef704a63e6): created successfully Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0269986-351d-4fa5-8d9b-01df452fca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (95bab47b-0433-4410-93e7-08bc75465a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:23 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0e1dda8b-437a-476b-bb19-b8e522a12a22 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:23 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630" returned: 0 in 0.405s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78077fb9-4066-415f-847e-f204f06efcf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-ceed97e2-42e4-469e-84b7-38610c733886-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f049082-9a1e-4231-a559-fd7b7f12b80d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-ceed97e2-42e4-469e-84b7-38610c733886-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-ceed97e2-42e4-469e-84b7-38610c733886" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-ceed97e2-42e4-469e-84b7-38610c733886" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd992b62-4767-4c38-88a9-7caed964d627]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 Sep 02 16:35:23 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 Sep 02 16:35:23 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1073741824" returned: 0 in 0.457s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 Sep 02 16:35:23 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9" returned: 0 in 0.422s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 Sep 02 16:35:23 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886 Sep 02 16:35:23 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.475s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1372928319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed49e30-6271-47b0-8302-d7389f4e0183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume 8ed49e30-6271-47b0-8302-d7389f4e0183 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:23 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 1073741824 Sep 02 16:35:23 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Attempting download of 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f ((None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}])) to volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae22d2b0-6876-4bc9-b15b-66725aae9d07]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:23 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ceed97e2-42e4-469e-84b7-38610c733886" returned: 0 in 0.295s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:23 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630 Sep 02 16:35:23 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:23 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-ceed97e2-42e4-469e-84b7-38610c733886" released by "delete_volume" :: held 0.800s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:24 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29 Sep 02 16:35:24 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['b98a4bb1-f923-4270-808d-ce1f3526ecf1', '91314ae9-329f-45ff-8f21-da7a17cfa649', '4bc59a67-528b-47f0-933e-85486325ee90', '2cef7544-9d44-4339-876e-9bebe6785d2e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:24 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9.f8cb2125-9456-4afd-9ae6-79a1c7ca7630" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-f8cb2125-9456-4afd-9ae6-79a1c7ca7630" released by "_delete_snapshot" :: held 1.654s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" released by "delete_snapshot" :: held 1.679s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:24 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29" returned: 0 in 0.425s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 1073741824" returned: 0 in 0.577s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29 Sep 02 16:35:24 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:24 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 Sep 02 16:35:24 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.334s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Created reservations ['c334ec0c-6cb6-4d40-b6ac-6ddec86d165d', 'bcebadf0-e6d8-41aa-a0ff-bda9bdaf7943', 'eeeeea70-80cc-4bb1-b75e-20329fb043a4', '79f13d46-2e63-4438-a245-9b13c780ead3'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6eaa66-a442-4404-9eb4-04c979b7fb75]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aa7c3b1b-101e-4bc4-8ec2-e3a5409b0c66 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-ceed97e2-42e4-469e-84b7-38610c733886-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Delete snapshot completed successfully. Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-56755b9a-6427-44b0-ab86-13dc602029dd tempest-ProjectReaderTests-303186967 None] Lock "cinder-f8cb2125-9456-4afd-9ae6-79a1c7ca7630-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:24 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29" returned: 1 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f_s_nrbn29' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20680b3d-85f3-474d-a929-62c0469a866c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 Sep 02 16:35:24 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-78077fb9-4066-415f-847e-f204f06efcf9-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "cinder-78077fb9-4066-415f-847e-f204f06efcf9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:24 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183" returned: 0 in 0.370s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.174s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879068825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058fd700-e82a-48d5-9c59-f1e2d158814b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:17Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume 058fd700-e82a-48d5-9c59-f1e2d158814b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:24 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:24 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:24 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:24 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b 1073741824 Sep 02 16:35:24 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a8712d-d70d-4c89-aecd-d0ef94b4bf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed49e30-6271-47b0-8302-d7389f4e0183', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046b5532-f5e7-4e05-bc82-27d8f6d44b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:24 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-8ed49e30-6271-47b0-8302-d7389f4e0183 (8ed49e30-6271-47b0-8302-d7389f4e0183): created successfully Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046b5532-f5e7-4e05-bc82-27d8f6d44b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (eb821f19-830a-482a-8e67-529dd3d1e010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" acquired by "delete_volume" :: waited 0.064s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-15df406a-6a70-406c-bba9-e11eb9a6078c tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d17fd74-14eb-434e-85e1-38fd3ae31a93]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" returned: 0 in 0.507s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7 Sep 02 16:35:25 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 Sep 02 16:35:25 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD Sep 02 16:35:25 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7" released by "delete_volume" :: held 0.867s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:25 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b 1073741824" returned: 0 in 0.584s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['fad4f080-7357-4191-9911-de0927de66c6', '190e9283-20b7-4494-b66e-7bf690218d82', '51c0c483-0b3a-417d-9753-b729c35b864a', '1d4bf820-887e-4edf-b979-a24314a9d3a3'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9" returned: 0 in 0.489s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b Sep 02 16:35:25 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9 Sep 02 16:35:25 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f was raw, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 Sep 02 16:35:25 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:25 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-78077fb9-4066-415f-847e-f204f06efcf9" returned: 0 in 0.309s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b" returned: 0 in 0.349s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-78077fb9-4066-415f-847e-f204f06efcf9" released by "delete_volume" :: held 0.892s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.724s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676831947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a945c-343f-495c-bb07-20748d4ff2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:18Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume 324a945c-343f-495c-bb07-20748d4ff2ca {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:25 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:25 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:25 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca 1073741824 Sep 02 16:35:25 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa7cc5-8368-44cb-95df-66caba501eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058fd700-e82a-48d5-9c59-f1e2d158814b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a03150d-45a7-472d-a10c-333558f425a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:25 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-058fd700-e82a-48d5-9c59-f1e2d158814b (058fd700-e82a-48d5-9c59-f1e2d158814b): created successfully Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a03150d-45a7-472d-a10c-333558f425a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (1ea3ddb2-7a65-491e-a230-ee279125165a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d9154318-b59d-411c-b8fb-8dcd7137c812 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-b0dbb8ab-fcb8-401e-ac8c-e79fa274bbe7-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b4abbaa1-d051-4b37-82f1-adb66b31d822 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:25 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Created reservations ['cd14cead-9187-4945-9702-901bc1e7a0cc', 'ec8a1b7f-eef4-4b12-b4ed-5e93853cf367', '0855ac9d-b9b6-4bf5-9e44-15e529112f95', '2383603a-10fe-4a48-aaf0-dee8571a7c22'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:26 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:26 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:26 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" returned: 0 in 0.542s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9cbafbf3-7a0f-4d70-8b2b-e9860821e94f__6rdk4gpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:26 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1G Sep 02 16:35:26 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:26 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.273s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Deleted volume successfully. Sep 02 16:35:26 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca 1073741824" returned: 0 in 0.518s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f0dd9208-3229-40dc-9b4c-ac64866e7095 tempest-ProjectReaderTests-303186967 None] Lock "cinder-78077fb9-4066-415f-847e-f204f06efcf9-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:26 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca Sep 02 16:35:26 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:26 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 1G" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Downloaded image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f ((None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}])) to volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Temporary image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f for user 03ad4e7a1978413588af8659100b4c31 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Marking volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Copying metadata from image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f to 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Creating volume glance metadata for volume 6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 backed by image 9cbafbf3-7a0f-4d70-8b2b-e9860821e94f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a524b05bb48f822e69d2520c04523a93', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1464048-8c45-4498-a02b-bbaa4894e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22', 'volume_size': 1, 'image_id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a524b05bb48f822e69d2520c04523a93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fab6d0ecc01641cba591467da54aae6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34b64edd803aad1f8e47d7b566d32b125e486f96688d3cccfa60b4384c94136f76e30348fea97c97f06ec41ecff0acd425b623bf15480f8e965ba94bd5455fd', 'id': '9cbafbf3-7a0f-4d70-8b2b-e9860821e94f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cbafbf3-7a0f-4d70-8b2b-e9860821e94f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aed1ef9-5d0a-4214-a0dc-d6bb259ae2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-f94b59f1-d023-451b-90f4-7f49009d1404-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-f94b59f1-d023-451b-90f4-7f49009d1404-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Volume volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 (6bae8cae-3d77-45c5-bac0-cb5ea0bcda22): created successfully Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aed1ef9-5d0a-4214-a0dc-d6bb259ae2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Flow 'volume_create_manager' (2b24c756-c627-4d90-aef5-1dd096b68014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4edb4a10-98f8-4ace-a1bc-52adadd626f2 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Created volume successfully. Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-f94b59f1-d023-451b-90f4-7f49009d1404" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:26 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-f94b59f1-d023-451b-90f4-7f49009d1404" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.323s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497108486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da124fd8-a906-4d49-b722-de4f79330d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df75fa3964cda9a64da4b7cb5b405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:18Z,use_quota=True,user_id='f78d0ea1e9d54dab8188fd174a1bc75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Creating volume da124fd8-a906-4d49-b722-de4f79330d9e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f0988-abe8-470d-9a96-ea754fba1d18]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:26 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e 1073741824 Sep 02 16:35:26 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46110d-e552-4fa5-b4ff-116702242b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324a945c-343f-495c-bb07-20748d4ff2ca', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f702ea75-d3ae-487e-87db-9537059c458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-324a945c-343f-495c-bb07-20748d4ff2ca (324a945c-343f-495c-bb07-20748d4ff2ca): created successfully Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f702ea75-d3ae-487e-87db-9537059c458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (275349a3-def4-44f0-9e1d-608f79eb26c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:26 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1c3afa12-3e4e-4ae2-b237-a984dbbfda16 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:26 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 Sep 02 16:35:26 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404" returned: 0 in 0.433s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404 Sep 02 16:35:27 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e 1073741824" returned: 0 in 0.509s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:27 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e Sep 02 16:35:27 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Acquiring lock "cinder-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "cinder-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Acquiring lock "cinder-quobyte-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "cinder-quobyte-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f3ca56-6e95-4e7f-ad9d-385af5d23bd2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-f94b59f1-d023-451b-90f4-7f49009d1404" returned: 0 in 0.399s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-f94b59f1-d023-451b-90f4-7f49009d1404" released by "delete_volume" :: held 0.902s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:27 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (a111155a-e5d5-4db6-a7ff-e1330befb6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bc1a9-ff44-44ad-8fc5-b2c89408da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bc1a9-ff44-44ad-8fc5-b2c89408da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384926823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae1aba0-9046-44f7-a4da-8c30ccbef328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:28Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b89252-496e-459e-bec9-29c16a1d97f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b89252-496e-459e-bec9-29c16a1d97f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 Sep 02 16:35:27 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fbcfc4-728c-42b7-a23d-58c14fa35a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fbcfc4-728c-42b7-a23d-58c14fa35a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae1aba0-9046-44f7-a4da-8c30ccbef328', 'volume_name': 'volume-fae1aba0-9046-44f7-a4da-8c30ccbef328', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bf987e-f950-4359-8276-abe6ef46e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bf987e-f950-4359-8276-abe6ef46e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3794d9-86c8-4b26-93d3-58acb1c19777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Volume fae1aba0-9046-44f7-a4da-8c30ccbef328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae1aba0-9046-44f7-a4da-8c30ccbef328', 'volume_size': 1} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384926823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae1aba0-9046-44f7-a4da-8c30ccbef328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:28Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Creating volume fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:27 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01409f0c-f236-48fb-a0f3-7393a9d0f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da124fd8-a906-4d49-b722-de4f79330d9e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6a9765-fb20-4ff1-87b5-0a849b6b3358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:27 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 1073741824 Sep 02 16:35:27 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Volume volume-da124fd8-a906-4d49-b722-de4f79330d9e (da124fd8-a906-4d49-b722-de4f79330d9e): created successfully Sep 02 16:35:27 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6a9765-fb20-4ff1-87b5-0a849b6b3358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Flow 'volume_create_manager' (a2dccc74-3e74-4a90-8670-74c278c3ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4f574681-a4fa-4f6b-ba09-b4e63809b9e4 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created volume successfully. Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['b6795c46-fcae-4ac2-bdc6-51a23e932f35', 'e8301f23-f75d-4924-b96e-5efd93277e7a', '3fb52326-c684-4476-8498-7dbcf4412cc1', '6daef660-596f-4175-8a93-e43146e9e05a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:27 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:27 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" returned: 0 in 0.402s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:27 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22 Sep 02 16:35:27 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:28 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-89ea6245-2931-446d-abb5-f038c3e81339 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-f94b59f1-d023-451b-90f4-7f49009d1404-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:28 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 1073741824" returned: 0 in 0.525s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-da124fd8-a906-4d49-b722-de4f79330d9e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "cinder-quobyte-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22" released by "delete_volume" :: held 0.772s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-da124fd8-a906-4d49-b722-de4f79330d9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:28 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 Sep 02 16:35:28 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-da124fd8-a906-4d49-b722-de4f79330d9e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Created reservations ['ff2f66e4-113d-4c2d-94ce-62a065b366d3', 'aa5d999f-ef76-43fb-ae49-7857de463e03', 'e8f85376-ee06-4e47-aa30-416c81eabc23', 'a556fa56-1ab2-4bd9-990f-681d67dd0c81'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-da124fd8-a906-4d49-b722-de4f79330d9e" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee1fc0-2131-40ac-981d-2c24dcb7c8a0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:28 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:28 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:28 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e Sep 02 16:35:28 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:28 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328" returned: 0 in 0.299s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3794d9-86c8-4b26-93d3-58acb1c19777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae1aba0-9046-44f7-a4da-8c30ccbef328', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b070f99e-eecd-4742-95cc-1fe12924705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:28 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Volume volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 (fae1aba0-9046-44f7-a4da-8c30ccbef328): created successfully Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b070f99e-eecd-4742-95cc-1fe12924705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (a111155a-e5d5-4db6-a7ff-e1330befb6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-77038d22-4504-48e9-8b78-1c92e714771f tempest-ProjectReaderTests-303186967 None] Created volume successfully. Sep 02 16:35:28 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Deleted volume successfully. Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09fff0fc-5c0c-4869-9f58-341da370c747 tempest-VolumeAndVolumeTypeFromImageTest-1425589672 None] Lock "cinder-6bae8cae-3d77-45c5-bac0-cb5ea0bcda22-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-205dd9c9-40d4-442d-bf9b-cce3143f675b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:28 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e" returned: 0 in 0.496s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-205dd9c9-40d4-442d-bf9b-cce3143f675b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:28 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e Sep 02 16:35:28 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-205dd9c9-40d4-442d-bf9b-cce3143f675b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-205dd9c9-40d4-442d-bf9b-cce3143f675b" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5487392-0d5b-43e0-bff4-a288e04af3f4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:29 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b Sep 02 16:35:29 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:29 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-da124fd8-a906-4d49-b722-de4f79330d9e" returned: 0 in 0.305s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-da124fd8-a906-4d49-b722-de4f79330d9e" released by "delete_volume" :: held 0.852s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['adfa454f-d402-4b65-a1b7-2f34c839c1cd', 'd5e900f1-0502-498c-a148-f4d32702892c', 'de1da658-dce8-4286-8d01-7ca51901e16e', '4ba2edd0-2a6d-4c50-82c6-8872cd5403b1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:29 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:29 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:29 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b" returned: 0 in 0.428s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-324a945c-343f-495c-bb07-20748d4ff2ca-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:29 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b Sep 02 16:35:29 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-324a945c-343f-495c-bb07-20748d4ff2ca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-324a945c-343f-495c-bb07-20748d4ff2ca" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-324a945c-343f-495c-bb07-20748d4ff2ca" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de678618-cb64-45b3-a210-b5fc293aff28]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:29 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.411s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:29 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca Sep 02 16:35:29 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae614c56-9001-41ab-bdc0-99cfef5f4ab1 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-da124fd8-a906-4d49-b722-de4f79330d9e-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:29 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-205dd9c9-40d4-442d-bf9b-cce3143f675b" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-205dd9c9-40d4-442d-bf9b-cce3143f675b" released by "delete_volume" :: held 0.879s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:29 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['e06d7b56-e54b-4188-b946-0e7ac0c51967', '9b457fec-3df9-40ea-99aa-e0a7cb44af28', '09eedb0d-e95d-4633-99c9-3ac21eb79f9e', '6b0a577e-0274-4488-bad3-f2bf8d93d9c1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Creating offline snapshot b1805cd1-f062-46e4-be3e-86985dfa0b71 of volume fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bc3a2b-6e1d-4848-95ab-5806077567c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:30 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:30 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:30 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca" returned: 0 in 0.525s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:30 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 Sep 02 16:35:30 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:30 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca Sep 02 16:35:30 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:30 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.337s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:30 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-511cbc76-f917-428b-ade9-cedbcbcf3946 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-205dd9c9-40d4-442d-bf9b-cce3143f675b-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:30 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-324a945c-343f-495c-bb07-20748d4ff2ca" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:30 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328" returned: 0 in 0.543s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-324a945c-343f-495c-bb07-20748d4ff2ca" released by "delete_volume" :: held 0.960s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:30 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 1G Sep 02 16:35:30 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['00de49bc-d7a8-4b92-9586-e201dfded29c', 'd6799f7a-ed14-4d47-afbc-30a3b848b177', '55d22bed-2184-46d0-819c-ac86eb35945c', '365af692-0bff-4525-941d-72fec6e7e650'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:30 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:30 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.290s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:31 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 1G" returned: 0 in 0.506s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:31 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e230edd9-efcd-40fe-b544-09060e0c0083 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-324a945c-343f-495c-bb07-20748d4ff2ca-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:31 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-47b7edda-7830-4e77-9241-711a3b0a7de1-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-47b7edda-7830-4e77-9241-711a3b0a7de1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-47b7edda-7830-4e77-9241-711a3b0a7de1" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-47b7edda-7830-4e77-9241-711a3b0a7de1" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0fb21-e178-4744-8ae7-e1f5c5125d85]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:31 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71" returned: 0 in 0.369s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:31 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 is being set with open permissions: ugo+rw Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:31 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 Sep 02 16:35:31 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 Sep 02 16:35:31 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:31 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1" returned: 0 in 0.407s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:31 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1 Sep 02 16:35:31 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:31 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info Sep 02 16:35:31 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-058fd700-e82a-48d5-9c59-f1e2d158814b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-058fd700-e82a-48d5-9c59-f1e2d158814b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-058fd700-e82a-48d5-9c59-f1e2d158814b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-058fd700-e82a-48d5-9c59-f1e2d158814b" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344d7aa-a895-4496-9678-4f42bc57ab20]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:32 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-47b7edda-7830-4e77-9241-711a3b0a7de1" returned: 0 in 0.380s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-47b7edda-7830-4e77-9241-711a3b0a7de1" released by "delete_volume" :: held 0.843s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:32 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info" returned: 0 in 0.376s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info is being set with open permissions: ugo+rw Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:32 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b Sep 02 16:35:32 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:32 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info Sep 02 16:35:32 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['c1f705d3-32f2-4cf8-9636-54691ef97ca6', '5774dba2-e257-4d9a-af63-e9db1519ffa4', '487c4d17-8eac-4545-872b-dbd057de47ec', 'ed395dfc-f2e9-4ec0-bef2-5e4b2db35392'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:32 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:32 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-0daca423-86b9-45b8-85a6-92f7e3407d8f-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-0daca423-86b9-45b8-85a6-92f7e3407d8f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "cinder-quobyte-0daca423-86b9-45b8-85a6-92f7e3407d8f" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:32 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.info" returned: 0 in 0.395s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-0daca423-86b9-45b8-85a6-92f7e3407d8f" acquired by "delete_volume" :: waited 0.044s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:32 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b" returned: 0 in 0.579s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c10d9ad-092f-4229-a458-e58cc7f8986c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:32 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b Sep 02 16:35:32 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.348s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:32 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a68473e3-92a1-4e64-b2a1-3167bac1c38e tempest-ProjectReaderTests-303186967 None] Create snapshot completed successfully Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2aebd0e0-9976-41da-a166-c1f3da21c5c2 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-47b7edda-7830-4e77-9241-711a3b0a7de1-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:32 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f Sep 02 16:35:32 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:32 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-058fd700-e82a-48d5-9c59-f1e2d158814b" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-058fd700-e82a-48d5-9c59-f1e2d158814b" released by "delete_volume" :: held 0.940s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['888f3c2e-a7da-408c-8900-f6719505ca36', 'd5922180-6f56-450b-be5b-ab1b68c0bae9', '8cfdd6e4-e2cf-4207-84b8-fcbb9d1a885c', 'c0bb09c1-c864-45f7-8963-a0819827bb6c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:33 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:33 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f Sep 02 16:35:33 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:33 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:33 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-b1805cd1-f062-46e4-be3e-86985dfa0b71-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-b1805cd1-f062-46e4-be3e-86985dfa0b71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-b1805cd1-f062-46e4-be3e-86985dfa0b71" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b1805cd1-f062-46e4-be3e-86985dfa0b71" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Deleting offline snapshot b1805cd1-f062-46e4-be3e-86985dfa0b71 of volume fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] snapshot_file for this snap is: volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2f3870-17e8-4e34-8504-b469a26de2b9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:33 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-0daca423-86b9-45b8-85a6-92f7e3407d8f" returned: 0 in 0.328s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-quobyte-0daca423-86b9-45b8-85a6-92f7e3407d8f" released by "delete_volume" :: held 0.835s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:33 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.332s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:33 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 Sep 02 16:35:33 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1ef61306-8edf-4cb1-be88-95af5ed8875a tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-058fd700-e82a-48d5-9c59-f1e2d158814b-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Created reservations ['f1a22f66-3796-4259-9ada-752a85c256c1', '4e03228c-7cfc-4304-911a-e1174cd69e2c', '7e4a1f75-d086-4450-ba04-1a8ddf03ec2c', '4c7d891e-1f32-4e54-b525-dbb0fcbb5ad5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:33 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:33 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:33 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71" returned: 0 in 0.506s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae1aba0-9046-44f7-a4da-8c30ccbef328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb1dff-7dc8-48e1-950b-0216901b2b6c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:33 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.328s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Deleted volume successfully. Sep 02 16:35:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-45d31b1d-eae9-48db-a3fd-c91598226436 tempest-CreateVolumesFromSourceVolumeTest-2122403728 None] Lock "cinder-0daca423-86b9-45b8-85a6-92f7e3407d8f-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:34 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 Sep 02 16:35:34 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (cb15a5fd-afbe-4f87-9422-c5ef559749b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e47b81-c8d0-46c3-9076-0e961208c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-8ed49e30-6271-47b0-8302-d7389f4e0183-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e47b81-c8d0-46c3-9076-0e961208c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38955030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df0b23e-f7d3-4f01-9eae-486ab243d673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:34Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72564ee3-e8a4-40e2-816c-d1fbdb4653ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72564ee3-e8a4-40e2-816c-d1fbdb4653ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb7bef8-a4cd-463a-a735-0de79dbaeaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb7bef8-a4cd-463a-a735-0de79dbaeaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df0b23e-f7d3-4f01-9eae-486ab243d673', 'volume_name': 'volume-3df0b23e-f7d3-4f01-9eae-486ab243d673', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fc8c68-011f-47cf-a015-c94a4d8a622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fc8c68-011f-47cf-a015-c94a4d8a622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7493d9-1286-4cec-b620-96e52dba4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Volume 3df0b23e-f7d3-4f01-9eae-486ab243d673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df0b23e-f7d3-4f01-9eae-486ab243d673', 'volume_size': 1} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38955030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df0b23e-f7d3-4f01-9eae-486ab243d673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:34Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Creating volume 3df0b23e-f7d3-4f01-9eae-486ab243d673 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:34 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-8ed49e30-6271-47b0-8302-d7389f4e0183-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:34 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 1073741824 Sep 02 16:35:34 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-8ed49e30-6271-47b0-8302-d7389f4e0183" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:34 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328" returned: 0 in 0.588s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-8ed49e30-6271-47b0-8302-d7389f4e0183" acquired by "delete_volume" :: waited 0.042s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:34 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 Sep 02 16:35:34 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc0a5f-4b13-437b-a598-f750d8c71755]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:34 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 Sep 02 16:35:34 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (d8d85ef7-4f08-4b74-ba08-50b6e3379167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9098d4a2-5c67-46c1-b87a-e023a3710cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9098d4a2-5c67-46c1-b87a-e023a3710cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162308823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060a3a1f-250b-42d0-ab8d-df06220acf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:35Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819c80c0-2886-4409-8795-116b8170a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819c80c0-2886-4409-8795-116b8170a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16052376-e81b-4928-81f1-e664e0677ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16052376-e81b-4928-81f1-e664e0677ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060a3a1f-250b-42d0-ab8d-df06220acf3e', 'volume_name': 'volume-060a3a1f-250b-42d0-ab8d-df06220acf3e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9b4163-232c-4db6-b074-2fb868b71eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9b4163-232c-4db6-b074-2fb868b71eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99405a7-1945-49d5-8ba9-237fb8bcacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Volume 060a3a1f-250b-42d0-ab8d-df06220acf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060a3a1f-250b-42d0-ab8d-df06220acf3e', 'volume_size': 1} Sep 02 16:35:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:35 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71" returned: 0 in 0.549s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:35 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71 Sep 02 16:35:35 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:35 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 1073741824" returned: 0 in 0.858s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183" returned: 0 in 0.742s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:35 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183 Sep 02 16:35:35 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:35 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 Sep 02 16:35:35 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (1f6bb7b7-e565-4c7c-b3f6-ac277845a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25404123-ef9e-40cf-8350-ce9eab14c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328.b1805cd1-f062-46e4-be3e-86985dfa0b71" returned: 0 in 0.500s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25404123-ef9e-40cf-8350-ce9eab14c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-972735513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f940d4f-e539-4105-ba29-bd236770601b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:35Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0df29b2-721b-4c8e-b23e-75a696332c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0df29b2-721b-4c8e-b23e-75a696332c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a81496f-506a-4987-827d-3c12a01119fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a81496f-506a-4987-827d-3c12a01119fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f940d4f-e539-4105-ba29-bd236770601b', 'volume_name': 'volume-9f940d4f-e539-4105-ba29-bd236770601b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e288b20-f4eb-4af7-98eb-ced12a73735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e288b20-f4eb-4af7-98eb-ced12a73735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a9cf59-a16c-4331-bc70-8ef5b52d0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Volume 9f940d4f-e539-4105-ba29-bd236770601b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f940d4f-e539-4105-ba29-bd236770601b', 'volume_size': 1} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b1805cd1-f062-46e4-be3e-86985dfa0b71" released by "_delete_snapshot" :: held 2.381s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" released by "delete_snapshot" :: held 2.421s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:35 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673" returned: 0 in 0.437s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:35 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162308823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060a3a1f-250b-42d0-ab8d-df06220acf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:35Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Creating volume 060a3a1f-250b-42d0-ab8d-df06220acf3e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:35 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-8ed49e30-6271-47b0-8302-d7389f4e0183" returned: 0 in 0.529s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7493d9-1286-4cec-b620-96e52dba4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df0b23e-f7d3-4f01-9eae-486ab243d673', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e 1073741824 Sep 02 16:35:35 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a383db5-87b2-4a92-90f9-9155718f2cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-8ed49e30-6271-47b0-8302-d7389f4e0183" released by "delete_volume" :: held 1.381s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:35 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Volume volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 (3df0b23e-f7d3-4f01-9eae-486ab243d673): created successfully Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a383db5-87b2-4a92-90f9-9155718f2cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (cb15a5fd-afbe-4f87-9422-c5ef559749b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-36563ec6-26be-4738-b271-b947f0d4d5ec tempest-CreateVolumesFromImageTest-1936688414 None] Created volume successfully. Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (0fc23f77-807e-4b26-a3f8-b2c30b7c3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:35 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5bf0f-3252-4b8c-bb57-41118e5d8036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5bf0f-3252-4b8c-bb57-41118e5d8036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345414092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e2503-a440-4961-beb5-7829f1e94b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:36Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0fda0c-1246-4afb-b2df-3fb87b98b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0fda0c-1246-4afb-b2df-3fb87b98b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db983a8-e1e4-47f3-88ee-d740a4df24ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db983a8-e1e4-47f3-88ee-d740a4df24ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133e2503-a440-4961-beb5-7829f1e94b0c', 'volume_name': 'volume-133e2503-a440-4961-beb5-7829f1e94b0c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f09ec1-54cf-4ac8-a458-95510d5b9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f09ec1-54cf-4ac8-a458-95510d5b9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e041d5e-7f1f-49f1-849b-916299a365e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Volume 133e2503-a440-4961-beb5-7829f1e94b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133e2503-a440-4961-beb5-7829f1e94b0c', 'volume_size': 1} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Created reservations ['bd611dff-308b-4db1-b777-91dcd9c29e91', '174992da-0e53-4683-9a2a-e4a9c6a5994f', '99825aaf-f000-489a-849d-822161d700ef', 'fae15db4-060d-40a5-840b-fde7b9c6f38c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['d1bf8c54-d041-472c-87eb-e8ba3106fd64', 'b8957797-5111-4d29-a294-eb1d660977c0', '0592005a-4af4-4794-8fc0-570deeea83a9', '369e1221-3bf3-4182-b2ea-3cf0953323f7'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Delete snapshot completed successfully. Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-63f7c921-c20c-45b0-9664-44703dd8b45e tempest-ProjectReaderTests-303186967 None] Lock "cinder-b1805cd1-f062-46e4-be3e-86985dfa0b71-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:36 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:36 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:36 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (37fa035d-19f9-4ca4-b4b3-9d15467ad90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0631a95f-30bd-441f-9c83-5765df2a8ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e 1073741824" returned: 0 in 0.701s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:36 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0631a95f-30bd-441f-9c83-5765df2a8ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407663078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb487f56-9ce2-45d2-9787-7347ef783d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:36Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ea21fa-2aa4-42a4-baae-952d63ecad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ea21fa-2aa4-42a4-baae-952d63ecad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927a0645-27f7-44c5-b6fb-92d4e5f7f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927a0645-27f7-44c5-b6fb-92d4e5f7f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb487f56-9ce2-45d2-9787-7347ef783d4a', 'volume_name': 'volume-bb487f56-9ce2-45d2-9787-7347ef783d4a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1142d1-0e8d-4e96-b5be-150371295d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1142d1-0e8d-4e96-b5be-150371295d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245966a4-2145-49dd-a2fb-0fa5fdebd910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:36 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Volume bb487f56-9ce2-45d2-9787-7347ef783d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb487f56-9ce2-45d2-9787-7347ef783d4a', 'volume_size': 1} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.379s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:36 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8266f0f6-b0b0-412c-a73f-a5f3a098be93 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-8ed49e30-6271-47b0-8302-d7389f4e0183-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:36 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e Sep 02 16:35:36 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-c5ee1c92-2598-4e97-9190-feef704a63e6-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-c5ee1c92-2598-4e97-9190-feef704a63e6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-fae1aba0-9046-44f7-a4da-8c30ccbef328-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "cinder-fae1aba0-9046-44f7-a4da-8c30ccbef328-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-c5ee1c92-2598-4e97-9190-feef704a63e6" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-c5ee1c92-2598-4e97-9190-feef704a63e6" acquired by "delete_volume" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[72946425-06ad-4439-abe3-60fa28dbccb4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:36 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e" returned: 0 in 0.329s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-972735513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f940d4f-e539-4105-ba29-bd236770601b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:35Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Creating volume 9f940d4f-e539-4105-ba29-bd236770601b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:36 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839c706-8f71-4131-8a31-5e5d3455d00f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:36 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b 1073741824 Sep 02 16:35:37 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99405a7-1945-49d5-8ba9-237fb8bcacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060a3a1f-250b-42d0-ab8d-df06220acf3e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:37 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 Sep 02 16:35:37 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b9a79-cf0d-4cab-a0a3-f77e7ec82f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:37 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Volume volume-060a3a1f-250b-42d0-ab8d-df06220acf3e (060a3a1f-250b-42d0-ab8d-df06220acf3e): created successfully Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b9a79-cf0d-4cab-a0a3-f77e7ec82f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (d8d85ef7-4f08-4b74-ba08-50b6e3379167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-06a3d20d-f166-4423-af67-629dd7442381 tempest-CreateVolumesFromImageTest-1936688414 None] Created volume successfully. Sep 02 16:35:37 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 Sep 02 16:35:37 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6" returned: 0 in 0.460s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:37 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6 Sep 02 16:35:37 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328" returned: 0 in 0.509s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:37 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328 Sep 02 16:35:37 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b 1073741824" returned: 0 in 0.582s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:37 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b Sep 02 16:35:37 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-c5ee1c92-2598-4e97-9190-feef704a63e6" returned: 0 in 0.315s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-c5ee1c92-2598-4e97-9190-feef704a63e6" released by "delete_volume" :: held 0.833s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['a2ae60b8-6763-41b4-8379-ef284a13e680', '8af7827f-6c68-4e7e-b428-2d464164511f', 'dfac00ed-6b7a-4991-83ca-2e76e2a3a75c', 'da7fdfa0-d0ff-4efe-a973-68a9734ef4bc'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:37 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-fae1aba0-9046-44f7-a4da-8c30ccbef328" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-fae1aba0-9046-44f7-a4da-8c30ccbef328" released by "delete_volume" :: held 0.991s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:37 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:37 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b" returned: 0 in 0.324s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345414092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e2503-a440-4961-beb5-7829f1e94b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:36Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Creating volume 133e2503-a440-4961-beb5-7829f1e94b0c {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:37 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a9cf59-a16c-4331-bc70-8ef5b52d0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f940d4f-e539-4105-ba29-bd236770601b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52501f23-acbb-43b0-b7bf-d5f9a2ba2298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c 1073741824 Sep 02 16:35:38 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-47c7229b-cf87-4e37-a50d-5e67c637d74d-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Volume volume-9f940d4f-e539-4105-ba29-bd236770601b (9f940d4f-e539-4105-ba29-bd236770601b): created successfully Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52501f23-acbb-43b0-b7bf-d5f9a2ba2298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (1f6bb7b7-e565-4c7c-b3f6-ac277845a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-47c7229b-cf87-4e37-a50d-5e67c637d74d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6e40e791-5f4f-47f6-b9cf-7a8aee3b2064 tempest-CreateVolumesFromImageTest-1936688414 None] Created volume successfully. Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-47c7229b-cf87-4e37-a50d-5e67c637d74d" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Created reservations ['932ff24d-db02-43e9-8798-d54c76660c6e', 'a28a4032-c8e2-4956-a432-0237ff9c806f', '50aa7ed2-9dd7-4cbc-adb8-78e83f9949b4', 'ca9653f3-5b29-49e2-a702-9482ed15863e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-47c7229b-cf87-4e37-a50d-5e67c637d74d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleting offline snapshot 47c7229b-cf87-4e37-a50d-5e67c637d74d of volume 486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] snapshot_file for this snap is: volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45153532-773d-4c82-a169-2502d9dd688e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Flow 'volume_create_manager' (74e5795a-b943-4efe-86e0-149205c9bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be898449-8260-4660-8125-2235c88c998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be898449-8260-4660-8125-2235c88c998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1356156011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8fe79e-722f-4138-9293-e9c6b035ea03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab60814f327243a0b4434c2b5df96dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:38Z,use_quota=True,user_id='5e8d98d5ab1b4b7d939fe7fbad457aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d Sep 02 16:35:38 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47c958e-59c4-4234-8fcd-628805812858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:38 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47c958e-59c4-4234-8fcd-628805812858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5200dbd9-5122-4c42-80d5-8724a73c4236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5200dbd9-5122-4c42-80d5-8724a73c4236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8fe79e-722f-4138-9293-e9c6b035ea03', 'volume_name': 'volume-7e8fe79e-722f-4138-9293-e9c6b035ea03', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4537a34e-31a0-492c-bf21-48e49b89e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4537a34e-31a0-492c-bf21-48e49b89e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156249d2-11b9-4707-b380-42b38d0e45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Volume 7e8fe79e-722f-4138-9293-e9c6b035ea03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8fe79e-722f-4138-9293-e9c6b035ea03', 'volume_size': 1} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-eedbd320-8402-49b5-bc05-12c390c8f491 tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-c5ee1c92-2598-4e97-9190-feef704a63e6-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:38 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c 1073741824" returned: 0 in 0.547s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c Sep 02 16:35:38 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Deleted volume successfully. Sep 02 16:35:38 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ac3f1cc3-c0f1-403d-9a7f-3265488b1b74 tempest-ProjectReaderTests-303186967 None] Lock "cinder-fae1aba0-9046-44f7-a4da-8c30ccbef328-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d" returned: 0 in 0.438s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-486d9d3c-834d-4cd7-9af6-0e06af24659e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50675ff1-2525-4415-982c-a05f4fdcf7de]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:38 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:38 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.275s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407663078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb487f56-9ce2-45d2-9787-7347ef783d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d8fcaeac44c219eac7022a9d91c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:36Z,use_quota=True,user_id='a182f302755b4d82963b274c7e243d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Creating volume bb487f56-9ce2-45d2-9787-7347ef783d4a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e041d5e-7f1f-49f1-849b-916299a365e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133e2503-a440-4961-beb5-7829f1e94b0c', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f1ac16-ee16-4d41-97fe-4143da0e7a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:38 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a 1073741824 Sep 02 16:35:38 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Volume volume-133e2503-a440-4961-beb5-7829f1e94b0c (133e2503-a440-4961-beb5-7829f1e94b0c): created successfully Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f1ac16-ee16-4d41-97fe-4143da0e7a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (0fc23f77-807e-4b26-a3f8-b2c30b7c3481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f1de7306-e9bf-40f2-a7cc-4a2624a3f1fc tempest-CreateVolumesFromImageTest-1936688414 None] Created volume successfully. Sep 02 16:35:39 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:39 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d Sep 02 16:35:39 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:39 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a 1073741824" returned: 0 in 0.468s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:39 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a Sep 02 16:35:39 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:39 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:39 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d Sep 02 16:35:39 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:39 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a" returned: 0 in 0.287s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1356156011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8fe79e-722f-4138-9293-e9c6b035ea03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab60814f327243a0b4434c2b5df96dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:38Z,use_quota=True,user_id='5e8d98d5ab1b4b7d939fe7fbad457aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Creating volume 7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:39 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:39 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 1073741824 Sep 02 16:35:39 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (d72be810-59cf-4203-96bf-d91ca3575904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ad96a6-8b31-4986-aae8-8c58991dabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245966a4-2145-49dd-a2fb-0fa5fdebd910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb487f56-9ce2-45d2-9787-7347ef783d4a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d9f301-f37b-4fc7-ae3e-e72026022689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Volume volume-bb487f56-9ce2-45d2-9787-7347ef783d4a (bb487f56-9ce2-45d2-9787-7347ef783d4a): created successfully Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d9f301-f37b-4fc7-ae3e-e72026022689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Flow 'volume_create_manager' (37fa035d-19f9-4ca4-b4b3-9d15467ad90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ad96a6-8b31-4986-aae8-8c58991dabd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038161599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e2173-3f49-448a-9f79-341816898dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:40Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7da3ce2-a208-4f1b-a767-e7309525dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7da3ce2-a208-4f1b-a767-e7309525dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05460ae3-fe09-4a72-839e-00e716176a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05460ae3-fe09-4a72-839e-00e716176a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83e2173-3f49-448a-9f79-341816898dc3', 'volume_name': 'volume-e83e2173-3f49-448a-9f79-341816898dc3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c5c4a6-9ac1-429a-9644-40e1eb776454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c5c4a6-9ac1-429a-9644-40e1eb776454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69336dfb-61ea-4e70-8cc0-2fcf380245a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:39 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Volume e83e2173-3f49-448a-9f79-341816898dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83e2173-3f49-448a-9f79-341816898dc3', 'volume_size': 1} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a86ae2fa-3852-4459-8b1c-799f5d6668fa tempest-CreateVolumesFromImageTest-1936688414 None] Created volume successfully. Sep 02 16:35:39 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e.47c7229b-cf87-4e37-a50d-5e67c637d74d" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-47c7229b-cf87-4e37-a50d-5e67c637d74d" released by "_delete_snapshot" :: held 1.714s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" released by "delete_snapshot" :: held 1.762s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-bb487f56-9ce2-45d2-9787-7347ef783d4a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-bb487f56-9ce2-45d2-9787-7347ef783d4a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:39 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['783fd62e-3f58-475c-bf1e-046680b85373', '44636d6c-1378-40a2-9214-d556917dbf5f', '1aff15ec-4e4d-4b42-8d56-f0c85d6c14e4', '0da53f49-5823-4a8d-be98-143ed8f8e9e8'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-quobyte-bb487f56-9ce2-45d2-9787-7347ef783d4a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-bb487f56-9ce2-45d2-9787-7347ef783d4a" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Delete snapshot completed successfully. Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b796ef-dd86-4e4a-b6d9-166451ee84ce]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ef9e049f-5e34-4399-8484-f8d34565011f tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-47c7229b-cf87-4e37-a50d-5e67c637d74d-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-486d9d3c-834d-4cd7-9af6-0e06af24659e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-486d9d3c-834d-4cd7-9af6-0e06af24659e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:40 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:40 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a Sep 02 16:35:40 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 1073741824" returned: 0 in 0.605s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37221dd4-280e-4bfc-abe9-3537a66bb969]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:40 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e Sep 02 16:35:40 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a" returned: 0 in 0.421s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a Sep 02 16:35:40 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.310s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038161599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e2173-3f49-448a-9f79-341816898dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:40Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Creating volume e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:40 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 1073741824 Sep 02 16:35:40 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:40 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156249d2-11b9-4707-b380-42b38d0e45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8fe79e-722f-4138-9293-e9c6b035ea03', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7362e74a-b237-4cb8-a95d-71f3133a8c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:40 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Volume volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 (7e8fe79e-722f-4138-9293-e9c6b035ea03): created successfully Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7362e74a-b237-4cb8-a95d-71f3133a8c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:40 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e Sep 02 16:35:40 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Flow 'volume_create_manager' (74e5795a-b943-4efe-86e0-149205c9bff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3cc322fb-be28-42ce-a168-a2000bdf8b04 tempest-VolumeDependencyTests-117098873 None] Created volume successfully. Sep 02 16:35:40 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-bb487f56-9ce2-45d2-9787-7347ef783d4a" returned: 0 in 0.340s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-bb487f56-9ce2-45d2-9787-7347ef783d4a" released by "delete_volume" :: held 0.817s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:40 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Created reservations ['0691bc2e-7ae9-43a4-8fc3-cb41716ff3a1', 'ed9d05e6-595b-4079-9af6-0f6eb6f74e59', '501ad3ce-9e09-4374-be44-d8e76a82ce00', '2487516a-a42c-4166-bb62-7ad8dc05a7cb'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:41 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-486d9d3c-834d-4cd7-9af6-0e06af24659e" returned: 0 in 0.342s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:41 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-quobyte-486d9d3c-834d-4cd7-9af6-0e06af24659e" released by "delete_volume" :: held 0.836s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:41 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Created reservations ['8e8129cf-3530-43ac-a4b4-7997b78034d4', '920f79cc-08c7-4ac6-b162-6d4f532e8e9f', '3cf376bd-9eeb-4aac-9649-cd33bb7fef40', 'b815914e-9bba-47ae-8c5d-7a32a13914d6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-133e2503-a440-4961-beb5-7829f1e94b0c-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-133e2503-a440-4961-beb5-7829f1e94b0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-quobyte-133e2503-a440-4961-beb5-7829f1e94b0c" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:41 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:41 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:41 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 1073741824" returned: 0 in 0.678s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-133e2503-a440-4961-beb5-7829f1e94b0c" acquired by "delete_volume" :: waited 0.048s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c60fb-a2da-4fee-a9bd-61c43aa0710e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:41 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Deleted volume successfully. Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:41 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 Sep 02 16:35:41 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5d5ab10b-4366-411f-8c28-57e40715bca7 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-bb487f56-9ce2-45d2-9787-7347ef783d4a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:41 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.497s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:41 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c Sep 02 16:35:41 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Deleted volume successfully. Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e2afeabf-3056-4c58-8c75-790a92d37ddb tempest-CreateVolumesFromSnapshotTest-289357254 None] Lock "cinder-486d9d3c-834d-4cd7-9af6-0e06af24659e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:41 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.064s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69336dfb-61ea-4e70-8cc0-2fcf380245a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83e2173-3f49-448a-9f79-341816898dc3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31876df3-bb26-4c9d-baec-347dd41768be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Creating offline snapshot 327d2a6d-e541-4e7d-b20a-547d9a761a8f of volume 7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:41 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Volume volume-e83e2173-3f49-448a-9f79-341816898dc3 (e83e2173-3f49-448a-9f79-341816898dc3): created successfully Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31876df3-bb26-4c9d-baec-347dd41768be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (d72be810-59cf-4203-96bf-d91ca3575904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f656f2-a136-4019-9811-e52a6c1234af]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-94bf6a0e-2ee2-4843-aebb-3ca3a434971b tempest-ProjectReaderTests-303186967 None] Created volume successfully. Sep 02 16:35:42 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:42 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:42 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c" returned: 0 in 0.679s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:42 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c Sep 02 16:35:42 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:42 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.456s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:42 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-133e2503-a440-4961-beb5-7829f1e94b0c" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-133e2503-a440-4961-beb5-7829f1e94b0c" released by "delete_volume" :: held 1.043s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:42 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f 1G Sep 02 16:35:42 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Created reservations ['e6f186e2-0938-4787-a31e-cad387da59a0', '64ee431a-d930-4e10-8bd7-344bbc98c84a', '01759bb1-323b-4a76-a8d7-448ff2689da6', '5856e315-355c-4fa9-9265-8191d026e033'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:42 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:42 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:42 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Deleted volume successfully. Sep 02 16:35:42 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f 1G" returned: 0 in 0.622s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-753b2adc-0354-4727-ab2b-952281428a98 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-133e2503-a440-4961-beb5-7829f1e94b0c-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:43 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:43 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:43 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:43 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f is being set with open permissions: ugo+rw Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:43 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:43 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-9f940d4f-e539-4105-ba29-bd236770601b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-9f940d4f-e539-4105-ba29-bd236770601b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-quobyte-9f940d4f-e539-4105-ba29-bd236770601b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-9f940d4f-e539-4105-ba29-bd236770601b" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee0fccf-cd5c-4e63-8126-5eb19d6c6e78]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:43 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:43 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info Sep 02 16:35:43 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:43 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b Sep 02 16:35:43 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:43 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:43 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info is being set with open permissions: ugo+rw Sep 02 16:35:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:43 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info Sep 02 16:35:43 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:44 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:44 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b Sep 02 16:35:44 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:44 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.info" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Creating offline snapshot b54d122d-f4a7-4913-a488-20945206a89d of volume e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6f0a4a8e-2ccb-4567-8de8-d467256b7df8 tempest-VolumeDependencyTests-117098873 None] Create snapshot completed successfully Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b732357-e2d1-4596-9e24-b290652c6cd3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:44 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9f940d4f-e539-4105-ba29-bd236770601b" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-9f940d4f-e539-4105-ba29-bd236770601b" released by "delete_volume" :: held 0.781s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Created reservations ['8b81e87e-c249-499e-9e93-c2bcf31ee0ae', 'c242a53d-8c19-4b1a-8aad-1987f3a60ef5', 'eae788eb-e321-4c3b-8d10-8ca95d2e11fd', '1b9d792f-373b-4714-a3b7-1b461b15fd86'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:44 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 Sep 02 16:35:44 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:44 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:44 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:44 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3" returned: 0 in 0.436s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:44 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d 1G Sep 02 16:35:44 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Deleted volume successfully. Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7c8848ce-8b0e-4f83-afbc-c231b088f172 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-9f940d4f-e539-4105-ba29-bd236770601b-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-060a3a1f-250b-42d0-ab8d-df06220acf3e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-060a3a1f-250b-42d0-ab8d-df06220acf3e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-quobyte-060a3a1f-250b-42d0-ab8d-df06220acf3e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-060a3a1f-250b-42d0-ab8d-df06220acf3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c068bcd-4d28-4103-9d81-a7164a299c39]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:45 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d 1G" returned: 0 in 0.504s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2173-3f49-448a-9f79-341816898dc3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:45 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2173-3f49-448a-9f79-341816898dc3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d Sep 02 16:35:45 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:45 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e Sep 02 16:35:45 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:45 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2173-3f49-448a-9f79-341816898dc3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:45 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d is being set with open permissions: ugo+rw Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:45 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e" returned: 0 in 0.537s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:45 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d Sep 02 16:35:45 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:45 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e Sep 02 16:35:45 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Flow 'volume_create_manager' (1a0a628b-5a0a-4f8a-980a-1b85acccd132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41465fc9-0730-4f78-94c9-dbab824d746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41465fc9-0730-4f78-94c9-dbab824d746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1698185282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cfdf13-0259-4b64-9d0e-9ee06c059029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab60814f327243a0b4434c2b5df96dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=327d2a6d-e541-4e7d-b20a-547d9a761a8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:46Z,use_quota=True,user_id='5e8d98d5ab1b4b7d939fe7fbad457aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44046f0d-7a79-420f-9438-c10237bf3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44046f0d-7a79-420f-9438-c10237bf3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeae842c-ead5-47df-beb4-9d8473efc251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeae842c-ead5-47df-beb4-9d8473efc251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '99cfdf13-0259-4b64-9d0e-9ee06c059029', 'volume_name': 'volume-99cfdf13-0259-4b64-9d0e-9ee06c059029', 'volume_size': 1, 'snapshot_id': '327d2a6d-e541-4e7d-b20a-547d9a761a8f'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb34f63-756d-4e31-9674-e5a6995e0fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb34f63-756d-4e31-9674-e5a6995e0fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e0f509-7cb5-462b-8930-56a48b2b75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:45 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Volume 99cfdf13-0259-4b64-9d0e-9ee06c059029: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-99cfdf13-0259-4b64-9d0e-9ee06c059029', 'volume_size': 1, 'snapshot_id': '327d2a6d-e541-4e7d-b20a-547d9a761a8f'} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:45 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:45 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-060a3a1f-250b-42d0-ab8d-df06220acf3e" returned: 0 in 0.302s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-060a3a1f-250b-42d0-ab8d-df06220acf3e" released by "delete_volume" :: held 0.884s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:46 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info Sep 02 16:35:46 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Created reservations ['80cac15e-864f-4f6f-9350-f15e48536708', '730a1a77-c2ed-4f9f-a68b-167e7f69b37a', '8c7d6a58-785b-4824-a149-07334925f1b7', '4960a85f-8fd1-4530-96ee-e9dfd6ee8000'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:46 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:46 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-3df0b23e-f7d3-4f01-9eae-486ab243d673-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:46 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:46 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info is being set with open permissions: ugo+rw Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-3df0b23e-f7d3-4f01-9eae-486ab243d673-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:46 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info Sep 02 16:35:46 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "cinder-quobyte-3df0b23e-f7d3-4f01-9eae-486ab243d673" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-3df0b23e-f7d3-4f01-9eae-486ab243d673" acquired by "delete_volume" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[437853cd-b561-4c6a-8bf2-ed026ae0b2ef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:46 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.307s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Deleted volume successfully. Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-86d1b1c2-c1b9-4da3-bfd3-03e2bfa84c58 tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-060a3a1f-250b-42d0-ab8d-df06220acf3e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:46 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 Sep 02 16:35:46 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:46 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.info" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.782s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f-99cfdf13-0259-4b64-9d0e-9ee06c059029" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f-99cfdf13-0259-4b64-9d0e-9ee06c059029" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Creating volume 99cfdf13-0259-4b64-9d0e-9ee06c059029 from snapshot 327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-edb370c0-7206-4d82-8fdc-49852a1990cf tempest-ProjectReaderTests-303186967 None] Create snapshot completed successfully Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] snapshot: 327d2a6d-e541-4e7d-b20a-547d9a761a8f, volume: 99cfdf13-0259-4b64-9d0e-9ee06c059029, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4792d5-5ea1-40b3-8760-b9f190a2cd5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:46 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:46 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:46 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673" returned: 0 in 0.445s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:46 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673 Sep 02 16:35:46 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:47 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:47 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.390s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e8fe79e-722f-4138-9293-e9c6b035ea03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3df0b23e-f7d3-4f01-9eae-486ab243d673" returned: 0 in 0.265s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e60522-d087-4a83-93a3-c59cb8219e6f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-quobyte-3df0b23e-f7d3-4f01-9eae-486ab243d673" released by "delete_volume" :: held 0.767s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Created reservations ['552b1a44-4600-4e5c-b895-363b9e028ea0', '1a03368e-9f3e-4d9a-bef5-d504a7b2fb77', '83bec981-5421-4b17-a9a4-fa052146ae69', '408ecbc2-fdd3-4916-ba55-d6ac95a52cc2'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:47 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:47 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:47 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:47 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-b54d122d-f4a7-4913-a488-20945206a89d-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Flow 'volume_create_manager' (d33cdb0f-483d-4632-8db8-e7472e215b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f15a1e-d37b-46e1-90d9-0faeea7e4c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f15a1e-d37b-46e1-90d9-0faeea7e4c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956fbabc-2759-48e5-a784-542d26a2fc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d427f794188948db9e942c883ef10ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:47Z,use_quota=True,user_id='f4efd60b83554d4e83ac008c8c083035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a2cd25-7a92-4946-803d-c3b6e58d7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:47 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a2cd25-7a92-4946-803d-c3b6e58d7f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347b43f1-28c4-47af-ab2c-10c3a73c7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.image.glance [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Creating Keystone auth plugin from conf {{(pid=87051) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.506s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b54d122d-f4a7-4913-a488-20945206a89d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.143s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:47 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-b54d122d-f4a7-4913-a488-20945206a89d" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:47 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b54d122d-f4a7-4913-a488-20945206a89d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:47 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Deleting offline snapshot b54d122d-f4a7-4913-a488-20945206a89d of volume e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] snapshot_file for this snap is: volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.451s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d663b-c759-43a6-9a1d-54e158c46381]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:47 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Deleted volume successfully. Sep 02 16:35:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b1683312-2709-4a3d-b2d6-d4334e35304a tempest-CreateVolumesFromImageTest-1936688414 None] Lock "cinder-3df0b23e-f7d3-4f01-9eae-486ab243d673-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:47 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d Sep 02 16:35:47 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347b43f1-28c4-47af-ab2c-10c3a73c7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '956fbabc-2759-48e5-a784-542d26a2fc21', 'volume_name': 'volume-956fbabc-2759-48e5-a784-542d26a2fc21', 'volume_size': 1, 'image_id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0392450912d3ae4305837dd0000821d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd427f794188948db9e942c883ef10ac6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85743f92117760ef19f5b8425e67d42d9dbd5c603cc186de1ea9559894bfb8594ce2864dc96ef1f2aeac836df8566f58ca02fc45456b64f694f90c4ada12014d', 'id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6dfa469-5159-4e07-b23e-5733ae68513f/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06368b89-fe03-4eed-92ad-c0a8b9d54054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06368b89-fe03-4eed-92ad-c0a8b9d54054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe9113-9e8b-480d-8266-16e2e0951773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:48 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Volume 956fbabc-2759-48e5-a784-542d26a2fc21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-956fbabc-2759-48e5-a784-542d26a2fc21', 'volume_size': 1, 'image_id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0392450912d3ae4305837dd0000821d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd427f794188948db9e942c883ef10ac6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85743f92117760ef19f5b8425e67d42d9dbd5c603cc186de1ea9559894bfb8594ce2864dc96ef1f2aeac836df8566f58ca02fc45456b64f694f90c4ada12014d', 'id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6dfa469-5159-4e07-b23e-5733ae68513f/file', 'properties': {}}, 'image_service': } Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Trying to clone 956fbabc-2759-48e5-a784-542d26a2fc21 from image f6dfa469-5159-4e07-b23e-5733ae68513f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}]). {{(pid=87051) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 16:35:48 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d" returned: 0 in 0.469s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e83e2173-3f49-448a-9f79-341816898dc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 16:35:48 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Image download 0.00 MB at 0.00 MB/s Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce11b1f2-27bc-4a45-8aa1-c5debc3b6315]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[88086132-aa86-412f-9f47-804add7d8f8d]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:48 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 Sep 02 16:35:48 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:48 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:48 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:48 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:48 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:49 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:49 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.999s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:49 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:49 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:35:49 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3" returned: 0 in 1.423s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:49 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d Sep 02 16:35:49 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:50 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 1 in 0.924s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Temporary image f6dfa469-5159-4e07-b23e-5733ae68513f is fetched for user f4efd60b83554d4e83ac008c8c083035. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eb665a-e584-4e81-8a65-c6a0fd29aacf]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:50 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:50 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:50 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d" returned: 0 in 1.161s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:51 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d Sep 02 16:35:51 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:51 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 0 in 1.105s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:51 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3.b54d122d-f4a7-4913-a488-20945206a89d" returned: 0 in 0.781s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b54d122d-f4a7-4913-a488-20945206a89d" released by "_delete_snapshot" :: held 4.091s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:51 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" released by "delete_snapshot" :: held 4.143s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:51 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:51 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:52 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Created reservations ['7e62b37e-98f9-41ca-81f1-a41a2efe9ddc', 'efb6144c-65c4-4bf0-b554-6ea7022135d0', 'e0b19964-9838-4066-9444-e9fa73e048d5', '22c52c66-a169-4f53-901e-37ea98afad7d'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:52 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Delete snapshot completed successfully. Sep 02 16:35:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-aecc3e00-7273-4c37-9b05-32a5761d8514 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b54d122d-f4a7-4913-a488-20945206a89d-delete_snapshot" released by "delete_snapshot" :: held 4.537s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:52 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 1 in 0.903s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-e83e2173-3f49-448a-9f79-341816898dc3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "cinder-e83e2173-3f49-448a-9f79-341816898dc3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d39a84-1b27-45a1-9240-6c23035cdc8a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:53 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029" returned: 0 in 5.950s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:35:53 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Converted 1024.00 MB image at 172.05 MB/s Sep 02 16:35:53 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 is being set with open permissions: ugo+rw Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:53 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 Sep 02 16:35:53 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:53 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 Sep 02 16:35:53 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:53 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" released by "_copy_volume_from_snapshot" :: held 7.194s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f-99cfdf13-0259-4b64-9d0e-9ee06c059029" released by "_create_volume_from_snapshot" :: held 7.277s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.302s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.368s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956fbabc-2759-48e5-a784-542d26a2fc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d427f794188948db9e942c883ef10ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:47Z,use_quota=True,user_id='f4efd60b83554d4e83ac008c8c083035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Creating volume 956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:53 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:53 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:53 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1073741824 Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3" returned: 0 in 0.406s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:53 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e0f509-7cb5-462b-8930-56a48b2b75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cfdf13-0259-4b64-9d0e-9ee06c059029', 'volume_size': 1, 'snapshot_id': '327d2a6d-e541-4e7d-b20a-547d9a761a8f'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:53 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca17a25-a085-4a05-8d8e-af543a720373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:53 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3 Sep 02 16:35:53 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:54 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Volume volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 (99cfdf13-0259-4b64-9d0e-9ee06c059029): created successfully Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca17a25-a085-4a05-8d8e-af543a720373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Flow 'volume_create_manager' (1a0a628b-5a0a-4f8a-980a-1b85acccd132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4676a6c6-f939-4d69-bd24-936e3765a1ad tempest-VolumeDependencyTests-117098873 None] Created volume successfully. Sep 02 16:35:54 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e83e2173-3f49-448a-9f79-341816898dc3" returned: 0 in 0.278s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-e83e2173-3f49-448a-9f79-341816898dc3" released by "delete_volume" :: held 0.807s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Created reservations ['44825fe2-6f0c-488a-b708-8ce0d4a990fe', '38432abd-5097-4811-a398-943240a4d14d', '4c0caf6f-7164-4bfc-b993-480f72269c15', '676792c4-a49d-41ed-b1bf-4fe3f32b3b1f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:54 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:54 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:54 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1073741824" returned: 0 in 0.527s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:54 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 Sep 02 16:35:54 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-327d2a6d-e541-4e7d-b20a-547d9a761a8f-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:54 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-327d2a6d-e541-4e7d-b20a-547d9a761a8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Deleted volume successfully. Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Deleting offline snapshot 327d2a6d-e541-4e7d-b20a-547d9a761a8f of volume 7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] snapshot_file for this snap is: volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25a0b62c-bc59-4b38-9f1e-db72aad6fb5b tempest-ProjectReaderTests-303186967 None] Lock "cinder-e83e2173-3f49-448a-9f79-341816898dc3-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571f722-1684-4710-9286-615d518c0dc6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:54 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21" returned: 0 in 0.346s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Attempting download of f6dfa469-5159-4e07-b23e-5733ae68513f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}])) to volume 956fbabc-2759-48e5-a784-542d26a2fc21. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 16:35:54 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:54 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d81728-94aa-4401-97af-4a7f01688c7b]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:55 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9 Sep 02 16:35:55 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:55 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e8fe79e-722f-4138-9293-e9c6b035ea03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73418d2c-bfbb-49b8-8d6a-ec00c6bb0e3d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:55 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9" returned: 0 in 0.364s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:55 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:55 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:55 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9 Sep 02 16:35:55 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:55 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9" returned: 1 in 0.421s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6dfa469-5159-4e07-b23e-5733ae68513f_ujbj7ci9' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f78fea-5d4c-4330-8b82-d46668af44d0]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:55 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:55 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:55 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.676s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:55 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:55 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (94aea553-1b6e-4400-a1f5-392cc61dfa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008271cb-1494-475c-a237-f48affde09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:56 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008271cb-1494-475c-a237-f48affde09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937626387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ca926-97b5-478d-a5ba-ccfb5ad20f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:56Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b968ed-e88f-4631-8489-68141458484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b968ed-e88f-4631-8489-68141458484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7a4c65-205f-4c1d-88e7-2edef8177caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7a4c65-205f-4c1d-88e7-2edef8177caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43ca926-97b5-478d-a5ba-ccfb5ad20f0b', 'volume_name': 'volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1692465d-3b96-4b20-a75f-397031bd660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1692465d-3b96-4b20-a75f-397031bd660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15effa1d-c2f8-4248-bb52-67db7d9322f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Volume b43ca926-97b5-478d-a5ba-ccfb5ad20f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b', 'volume_size': 1} Sep 02 16:35:56 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b 1073741824 Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937626387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ca926-97b5-478d-a5ba-ccfb5ad20f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:35:56Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Creating volume b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:35:56 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:56 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:56 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.463s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:56 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD Sep 02 16:35:56 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f Sep 02 16:35:56 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD" returned: 1 in 0.480s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] f6dfa469-5159-4e07-b23e-5733ae68513f was raw, converting to qcow2 {{(pid=87051) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:56 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 Sep 02 16:35:56 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03.327d2a6d-e541-4e7d-b20a-547d9a761a8f" returned: 0 in 0.462s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b 1073741824" returned: 0 in 0.593s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:56 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-327d2a6d-e541-4e7d-b20a-547d9a761a8f" released by "_delete_snapshot" :: held 2.134s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" released by "delete_snapshot" :: held 2.171s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:56 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b Sep 02 16:35:56 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:56 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Created reservations ['b302003f-fc56-407b-b165-c2d7323dce35', '17080011-a91e-4607-a683-1117bec88324', 'd5c209c8-b67e-414f-86b9-6d935a434c86', '2e056d85-817e-438f-872d-69218b02b417'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Delete snapshot completed successfully. Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d0c22d4d-8204-4816-a3c1-1612c806e826 tempest-VolumeDependencyTests-117098873 None] Lock "cinder-327d2a6d-e541-4e7d-b20a-547d9a761a8f-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:57 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15effa1d-c2f8-4248-bb52-67db7d9322f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a12bbc-f870-4848-a0ce-8cd33a7d5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Volume volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b (b43ca926-97b5-478d-a5ba-ccfb5ad20f0b): created successfully Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a12bbc-f870-4848-a0ce-8cd33a7d5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (94aea553-1b6e-4400-a1f5-392cc61dfa72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae6132af-7720-4b97-a473-fd4a25e8e761 tempest-ProjectReaderTests-303186967 None] Created volume successfully. Sep 02 16:35:57 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21" returned: 0 in 0.591s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6dfa469-5159-4e07-b23e-5733ae68513f_fh0ikp3bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:57 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1G Sep 02 16:35:57 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:57 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 1G" returned: 0 in 0.350s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Downloaded image f6dfa469-5159-4e07-b23e-5733ae68513f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}])) to volume 956fbabc-2759-48e5-a784-542d26a2fc21 successfully. {{(pid=87051) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Temporary image f6dfa469-5159-4e07-b23e-5733ae68513f for user f4efd60b83554d4e83ac008c8c083035 is deleted. {{(pid=87051) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.volume_utils [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Marking volume 956fbabc-2759-48e5-a784-542d26a2fc21 as bootable. {{(pid=87051) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Copying metadata from image f6dfa469-5159-4e07-b23e-5733ae68513f to 956fbabc-2759-48e5-a784-542d26a2fc21. {{(pid=87051) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Creating volume glance metadata for volume 956fbabc-2759-48e5-a784-542d26a2fc21 backed by image f6dfa469-5159-4e07-b23e-5733ae68513f with: {'image_id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a0392450912d3ae4305837dd0000821d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87051) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe9113-9e8b-480d-8266-16e2e0951773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956fbabc-2759-48e5-a784-542d26a2fc21', 'volume_size': 1, 'image_id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6dfa469-5159-4e07-b23e-5733ae68513f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0392450912d3ae4305837dd0000821d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd427f794188948db9e942c883ef10ac6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85743f92117760ef19f5b8425e67d42d9dbd5c603cc186de1ea9559894bfb8594ce2864dc96ef1f2aeac836df8566f58ca02fc45456b64f694f90c4ada12014d', 'id': 'f6dfa469-5159-4e07-b23e-5733ae68513f', 'created_at': datetime.datetime(2026, 9, 2, 14, 35, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 14, 35, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6dfa469-5159-4e07-b23e-5733ae68513f/file', 'properties': {}}, 'image_service': }' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa3487f-251b-4465-8fa1-190754a98193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Volume volume-956fbabc-2759-48e5-a784-542d26a2fc21 (956fbabc-2759-48e5-a784-542d26a2fc21): created successfully Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa3487f-251b-4465-8fa1-190754a98193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Flow 'volume_create_manager' (d33cdb0f-483d-4632-8db8-e7472e215b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:35:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7d28420e-efbc-4931-b5f3-db6447e38936 tempest-VolumeImageDependencyTests-1803905347 None] Created volume successfully. Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-7e8fe79e-722f-4138-9293-e9c6b035ea03-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "cinder-7e8fe79e-722f-4138-9293-e9c6b035ea03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:57 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[51631e5b-a983-4170-bc18-e5abd77902b9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:58 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:58 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Creating offline snapshot b6394381-e119-46cb-ba81-8664101dd64c of volume b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fafa87-660e-4c9a-9120-cf8b4bef762e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:58 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.413s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:58 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03 Sep 02 16:35:58 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:58 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b Sep 02 16:35:58 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:58 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-7e8fe79e-722f-4138-9293-e9c6b035ea03" returned: 0 in 0.254s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-7e8fe79e-722f-4138-9293-e9c6b035ea03" released by "delete_volume" :: held 0.738s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Created reservations ['1c94c535-8507-43b3-9513-cc5002c7f965', '8d5c8757-eb60-419b-97a7-0078a94350b5', '60d8140a-5370-4ef3-89e1-6a6409cf504d', '89927b6a-d9f3-4eea-bdd7-dc6f2623246e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:35:58 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" returned: 0 in 0.444s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:58 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c 1G Sep 02 16:35:58 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:58 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:35:58 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Acquiring lock "cinder-956fbabc-2759-48e5-a784-542d26a2fc21-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:58 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "cinder-956fbabc-2759-48e5-a784-542d26a2fc21-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Acquiring lock "cinder-quobyte-956fbabc-2759-48e5-a784-542d26a2fc21" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "cinder-quobyte-956fbabc-2759-48e5-a784-542d26a2fc21" acquired by "delete_volume" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-99cfdf13-0259-4b64-9d0e-9ee06c059029-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfdab16-fb00-410c-bbd1-ef3f4e6675b3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "cinder-99cfdf13-0259-4b64-9d0e-9ee06c059029-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Acquiring lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de901aa-2e5a-4596-9163-4f99f707ed90]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:35:59 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:35:59 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Deleted volume successfully. Sep 02 16:35:59 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 Sep 02 16:35:59 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-fe1fc5cc-71ae-453c-9202-7e15156a94dd tempest-VolumeDependencyTests-117098873 None] Lock "cinder-7e8fe79e-722f-4138-9293-e9c6b035ea03-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:59 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 Sep 02 16:35:59 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c 1G" returned: 0 in 0.652s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c Sep 02 16:35:59 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21" returned: 0 in 0.498s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21 Sep 02 16:35:59 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029" returned: 0 in 0.510s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029 Sep 02 16:35:59 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c is being set with open permissions: ugo+rw Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:35:59 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 02 16:35:59 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-956fbabc-2759-48e5-a784-542d26a2fc21" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:35:59 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "cinder-quobyte-956fbabc-2759-48e5-a784-542d26a2fc21" released by "delete_volume" :: held 0.858s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:35:59 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Created reservations ['66a9409b-2867-4066-907c-05e63b7639c4', 'd038f513-0970-456d-8aea-cde33f43c8b0', '189b51b5-f1bc-4f18-a9a3-47eaba047176', 'fc01505d-c4bf-41c1-bd86-5c824c93c62f'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:00 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-99cfdf13-0259-4b64-9d0e-9ee06c059029" returned: 0 in 0.346s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "cinder-quobyte-99cfdf13-0259-4b64-9d0e-9ee06c059029" released by "delete_volume" :: held 0.936s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:00 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c" returned: 0 in 0.309s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:00 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info Sep 02 16:36:00 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Created reservations ['2ea9e779-a10e-4acc-b099-d4d4d3c1d57f', 'f89dd581-fb4f-4620-8979-9bf7e4293745', '0c4209f5-98ad-40fe-a763-f276256246a9', '2071a7dc-fb91-4065-848b-03e81e439583'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:00 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:00 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (372538bb-4556-469e-9a2f-ff16f3cfb4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f72d966-fcc7-4e38-b664-52ee794e43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f72d966-fcc7-4e38-b664-52ee794e43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916271440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c686fd-a5e2-4ff3-a55b-9c22ec195dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:00Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938e492a-d757-4aa1-84ac-4dba562e6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938e492a-d757-4aa1-84ac-4dba562e6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9f2c5c-0c83-4ff0-8033-8eb49f2d6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9f2c5c-0c83-4ff0-8033-8eb49f2d6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c686fd-a5e2-4ff3-a55b-9c22ec195dd5', 'volume_name': 'volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:00 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3256f1fe-7e07-4c06-8fb2-6991b8a896e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3256f1fe-7e07-4c06-8fb2-6991b8a896e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7385c513-676e-49b0-b939-a8d22748c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:00 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Volume 94c686fd-a5e2-4ff3-a55b-9c22ec195dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5', 'volume_size': 1} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:00 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.521s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info is being set with open permissions: ugo+rw Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Deleted volume successfully. Sep 02 16:36:00 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info Sep 02 16:36:00 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d18ff8e5-adab-4721-bc3d-158c85d79c56 tempest-VolumeImageDependencyTests-1803905347 None] Lock "cinder-956fbabc-2759-48e5-a784-542d26a2fc21-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:00 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.331s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Deleted volume successfully. Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2835be52-6aef-4402-9198-67f66ab4ae2e tempest-VolumeDependencyTests-117098873 None] Lock "cinder-99cfdf13-0259-4b64-9d0e-9ee06c059029-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:00 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.info" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916271440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c686fd-a5e2-4ff3-a55b-9c22ec195dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:00Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Creating volume 94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:00 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:00 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 1073741824 Sep 02 16:36:00 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-fb45b367-3537-4ee6-abcc-617832b621a2 tempest-ProjectReaderTests-303186967 None] Create snapshot completed successfully Sep 02 16:36:01 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 1073741824" returned: 0 in 0.526s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:01 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 Sep 02 16:36:01 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-b6394381-e119-46cb-ba81-8664101dd64c-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b6394381-e119-46cb-ba81-8664101dd64c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-b6394381-e119-46cb-ba81-8664101dd64c" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b6394381-e119-46cb-ba81-8664101dd64c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Deleting offline snapshot b6394381-e119-46cb-ba81-8664101dd64c of volume b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] snapshot_file for this snap is: volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8333b-fd5b-4da9-af4b-bb70e787ba83]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:01 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7385c513-676e-49b0-b939-a8d22748c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c336d41-8a62-439f-96ba-5f9b331b235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:01 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c Sep 02 16:36:01 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:01 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Volume volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 (94c686fd-a5e2-4ff3-a55b-9c22ec195dd5): created successfully Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c336d41-8a62-439f-96ba-5f9b331b235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:01 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (372538bb-4556-469e-9a2f-ff16f3cfb4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:01 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0bd984fa-dd0c-4d2e-87e7-49a46297c734 tempest-ProjectReaderTests-1163822184 None] Created volume successfully. Sep 02 16:36:02 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c" returned: 0 in 0.467s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec2ce9f-7423-4936-99b2-11931364ee09]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:02 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b Sep 02 16:36:02 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:02 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" returned: 0 in 0.487s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:02 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c Sep 02 16:36:02 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "cinder-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-quobyte-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:02 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c85cade-8327-433d-bedc-49b695911800]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:03 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 Sep 02 16:36:03 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:03 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:03 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c Sep 02 16:36:03 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:03 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b.b6394381-e119-46cb-ba81-8664101dd64c" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:03 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" returned: 0 in 0.449s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b6394381-e119-46cb-ba81-8664101dd64c" released by "_delete_snapshot" :: held 1.796s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" released by "delete_snapshot" :: held 1.831s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:03 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5 Sep 02 16:36:03 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Created reservations ['18cb0dda-a6eb-40b0-b95d-1d8a488ff462', 'b391fb8f-ff7d-4960-8f0a-1d1ba2d4f7d7', '6059e3c9-8fdd-4edb-83c7-83c463e438c0', '874d62f9-baf7-4033-8571-ae2e6e78f4c6'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Delete snapshot completed successfully. Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-baab1daf-c458-4e92-87c4-d3a86d393993 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b6394381-e119-46cb-ba81-8664101dd64c-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:03 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5" released by "delete_volume" :: held 0.804s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Created reservations ['7555d5e7-2c75-4cc4-871e-029d0adaa4a8', 'c9909eb9-9c59-49e9-a15a-19aa16f84bd4', 'f7fda549-2600-429a-a6b1-7a24dbee7621', '96960316-bcb9-4663-94a0-fd69cfc1ca73'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" acquired by "delete_volume" :: waited 0.038s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c7c39-3514-417c-ad46-6ffb144d681d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:04 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:04 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:04 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b Sep 02 16:36:04 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Flow 'volume_create_manager' (023a94d3-63aa-40ea-933e-2977c3932dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d4039-f0f2-46ae-85cf-d409909d620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d4039-f0f2-46ae-85cf-d409909d620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722e66d-c26b-4052-a335-7157cf1090f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f305d60d4e9a429bbc08fd1c88c929b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:04Z,use_quota=True,user_id='9508a7e7df35419c93ee8fe39d79d15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7524a-7c1f-47a7-a482-6b2c7b4bcd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7524a-7c1f-47a7-a482-6b2c7b4bcd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d793c4-dd76-4539-85cd-eca322863a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d793c4-dd76-4539-85cd-eca322863a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2722e66d-c26b-4052-a335-7157cf1090f9', 'volume_name': 'volume-2722e66d-c26b-4052-a335-7157cf1090f9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2125bb-0ded-4972-8848-0a108aa79ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2125bb-0ded-4972-8848-0a108aa79ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7981edd-6fb2-4301-ad98-2455c1f8fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Volume 2722e66d-c26b-4052-a335-7157cf1090f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2722e66d-c26b-4052-a335-7157cf1090f9', 'volume_size': 1} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722e66d-c26b-4052-a335-7157cf1090f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f305d60d4e9a429bbc08fd1c88c929b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:04Z,use_quota=True,user_id='9508a7e7df35419c93ee8fe39d79d15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Creating volume 2722e66d-c26b-4052-a335-7157cf1090f9 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:04 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:04 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.478s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:04 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Deleted volume successfully. Sep 02 16:36:04 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 1073741824 Sep 02 16:36:04 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-585e056a-9a2c-458b-8c02-e0a7b0104848 tempest-ProjectReaderTests-1163822184 None] Lock "cinder-94c686fd-a5e2-4ff3-a55b-9c22ec195dd5-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:04 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (1b8cb64b-8fe0-4f6b-970f-aef7eb5e37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459c70cc-067a-485f-8ba2-5a627b7bfd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" returned: 0 in 0.684s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459c70cc-067a-485f-8ba2-5a627b7bfd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551293861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa6a41a-4ff7-453a-b508-4120fa91cf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:05Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b Sep 02 16:36:04 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3686ad-c01f-48f1-9987-d4418399b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3686ad-c01f-48f1-9987-d4418399b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54417735-86f2-4496-8a4a-c2601c005966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54417735-86f2-4496-8a4a-c2601c005966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa6a41a-4ff7-453a-b508-4120fa91cf37', 'volume_name': 'volume-daa6a41a-4ff7-453a-b508-4120fa91cf37', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40be222c-804c-40cd-8727-623b028f4b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40be222c-804c-40cd-8727-623b028f4b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7236a947-2c05-4823-9190-92a3d6b161eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:04 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Volume daa6a41a-4ff7-453a-b508-4120fa91cf37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa6a41a-4ff7-453a-b508-4120fa91cf37', 'volume_size': 1} Sep 02 16:36:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:05 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" returned: 0 in 0.309s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b" released by "delete_volume" :: held 1.082s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Created reservations ['624dfc93-223d-40e7-bc32-1fd81282edc4', '8f5470b8-1740-4f7a-a005-e396c9c00013', 'a454c0a7-1b55-4925-ae5f-338d63f3c39a', '17707a1e-7650-4d12-9a2e-6bde181d05d5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:05 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 1073741824" returned: 0 in 0.567s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:05 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:05 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:05 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 Sep 02 16:36:05 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:05 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.269s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Deleted volume successfully. Sep 02 16:36:05 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551293861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa6a41a-4ff7-453a-b508-4120fa91cf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:05Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Creating volume daa6a41a-4ff7-453a-b508-4120fa91cf37 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-80a43740-c9f9-4e96-9dc1-2ef999371327 tempest-ProjectReaderTests-303186967 None] Lock "cinder-b43ca926-97b5-478d-a5ba-ccfb5ad20f0b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:05 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 1073741824 Sep 02 16:36:05 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-668cc139-2eda-4e38-8d85-ea4277532d5a tempest-ProjectAdminTests-867027225 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7958145141602, 'free_capacity_gb': 1773.7958145141602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87051) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7981edd-6fb2-4301-ad98-2455c1f8fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2722e66d-c26b-4052-a335-7157cf1090f9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b0591f-dad5-427d-bf47-4ec261ee823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Volume volume-2722e66d-c26b-4052-a335-7157cf1090f9 (2722e66d-c26b-4052-a335-7157cf1090f9): created successfully Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b0591f-dad5-427d-bf47-4ec261ee823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Flow 'volume_create_manager' (023a94d3-63aa-40ea-933e-2977c3932dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c32e7926-ec94-4443-924b-4f9f43ed2c28 tempest-CinderUnicodeTest-1578056727 None] Created volume successfully. Sep 02 16:36:05 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 1073741824" returned: 0 in 0.452s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:06 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 Sep 02 16:36:06 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:06 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37" returned: 0 in 0.273s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7236a947-2c05-4823-9190-92a3d6b161eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa6a41a-4ff7-453a-b508-4120fa91cf37', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f770d3e-2f0f-45f9-b309-d8b39f24f679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Volume volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 (daa6a41a-4ff7-453a-b508-4120fa91cf37): created successfully Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f770d3e-2f0f-45f9-b309-d8b39f24f679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (1b8cb64b-8fe0-4f6b-970f-aef7eb5e37fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4c51e42e-db22-461c-83d0-a540d8684339 tempest-ProjectReaderTests-1163822184 None] Created volume successfully. Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (5653750c-232f-4701-9cb2-8e3fedd3d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d65892-c430-484d-aacb-c95fdda8b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d65892-c430-484d-aacb-c95fdda8b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406406473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5ca028-3d22-4c22-ab18-cd23426018cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:07Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965dcbb5-b2e5-4a1b-9e44-872359f7c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965dcbb5-b2e5-4a1b-9e44-872359f7c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55df973-e33f-4aff-9fb3-560752a53fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55df973-e33f-4aff-9fb3-560752a53fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5ca028-3d22-4c22-ab18-cd23426018cd', 'volume_name': 'volume-ee5ca028-3d22-4c22-ab18-cd23426018cd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dc17f4-fe70-48bc-a379-c6e3af8263a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dc17f4-fe70-48bc-a379-c6e3af8263a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaca774-593d-4c2e-a38d-349b5630f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Volume ee5ca028-3d22-4c22-ab18-cd23426018cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5ca028-3d22-4c22-ab18-cd23426018cd', 'volume_size': 1} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406406473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5ca028-3d22-4c22-ab18-cd23426018cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4bff45e9a04cdaa59ae9e7007540ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:07Z,use_quota=True,user_id='db1edddcd32942988879b2599e5aab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Creating volume ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:06 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:06 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd 1073741824 Sep 02 16:36:06 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-daa6a41a-4ff7-453a-b508-4120fa91cf37-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "cinder-daa6a41a-4ff7-453a-b508-4120fa91cf37-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-quobyte-daa6a41a-4ff7-453a-b508-4120fa91cf37" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:06 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-daa6a41a-4ff7-453a-b508-4120fa91cf37" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3687db6-a750-4d83-8209-11483b2a0afc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:07 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 Sep 02 16:36:07 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Flow 'volume_create_manager' (0c7f0427-61c2-46a0-8dc3-c4d17e5ad00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e4976f-8838-4c81-8f6e-b21480b380ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e4976f-8838-4c81-8f6e-b21480b380ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2035648201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833198ed-3a9a-4bf6-85ce-ff49f378ca4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f305d60d4e9a429bbc08fd1c88c929b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:07Z,use_quota=True,user_id='9508a7e7df35419c93ee8fe39d79d15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df24b8cc-1908-43eb-bf37-c83a11b954b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df24b8cc-1908-43eb-bf37-c83a11b954b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8025525-456a-4a8c-bc3f-a03f6369e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8025525-456a-4a8c-bc3f-a03f6369e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833198ed-3a9a-4bf6-85ce-ff49f378ca4b', 'volume_name': 'volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a8199-ba36-4dad-949c-27aa9efb773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a8199-ba36-4dad-949c-27aa9efb773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782e4b54-a5f3-478c-b584-7c9d6d983807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Volume 833198ed-3a9a-4bf6-85ce-ff49f378ca4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b', 'volume_size': 1} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:07 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd 1073741824" returned: 0 in 0.610s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:07 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd Sep 02 16:36:07 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:07 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37" returned: 0 in 0.503s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:07 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37 Sep 02 16:36:07 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:07 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2035648201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833198ed-3a9a-4bf6-85ce-ff49f378ca4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f305d60d4e9a429bbc08fd1c88c929b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:07Z,use_quota=True,user_id='9508a7e7df35419c93ee8fe39d79d15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Creating volume 833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:07 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:07 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b 1073741824 Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaca774-593d-4c2e-a38d-349b5630f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5ca028-3d22-4c22-ab18-cd23426018cd', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af419392-9bf5-4e17-b974-f8cf14799cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:07 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Volume volume-ee5ca028-3d22-4c22-ab18-cd23426018cd (ee5ca028-3d22-4c22-ab18-cd23426018cd): created successfully Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af419392-9bf5-4e17-b974-f8cf14799cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Flow 'volume_create_manager' (5653750c-232f-4701-9cb2-8e3fedd3d98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:07 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-69dfbf65-bea9-4bd1-93e8-eca4392ceeda tempest-ProjectReaderTests-303186967 None] Created volume successfully. Sep 02 16:36:07 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-daa6a41a-4ff7-453a-b508-4120fa91cf37" returned: 0 in 0.298s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-daa6a41a-4ff7-453a-b508-4120fa91cf37" released by "delete_volume" :: held 0.862s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Created reservations ['1ac25d95-d0e3-4732-8424-88b85ca057a6', '3f2371a2-2eb2-4ea3-9d0a-d88d81e4dd3a', 'ec94ab0e-cc0c-49b8-8c06-d11c565bdce4', 'f204de04-98db-4807-967d-7d69e0289061'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:08 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:08 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:08 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b 1073741824" returned: 0 in 0.610s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:08 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.366s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Deleted volume successfully. Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=345,cinder:SELECT=258,cinder:INSERT=91,cinder:DELETE=33 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:36:08 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b Sep 02 16:36:08 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ee26df-c660-48c0-aeea-13d631b624ca tempest-ProjectReaderTests-1163822184 None] Lock "cinder-daa6a41a-4ff7-453a-b508-4120fa91cf37-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:08 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (d5889ba2-e253-4ef2-85a9-07c0ddd24e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f09ea7b-2fbc-423d-b6e2-92eebe2076fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" returned: 0 in 0.340s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f09ea7b-2fbc-423d-b6e2-92eebe2076fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020604200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e696061-5300-48f1-b31d-7df632477129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:09Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92110a7-2294-457c-a707-96d968677efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92110a7-2294-457c-a707-96d968677efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0e45c1-ab3b-45e8-b7e4-ebf3e91fe57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0e45c1-ab3b-45e8-b7e4-ebf3e91fe57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e696061-5300-48f1-b31d-7df632477129', 'volume_name': 'volume-6e696061-5300-48f1-b31d-7df632477129', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef98534-1d6f-4294-84b2-251024cbb11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef98534-1d6f-4294-84b2-251024cbb11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442c44a-352e-4434-88ac-91340ec74c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Volume 6e696061-5300-48f1-b31d-7df632477129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e696061-5300-48f1-b31d-7df632477129', 'volume_size': 1} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020604200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e696061-5300-48f1-b31d-7df632477129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:09Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Creating volume 6e696061-5300-48f1-b31d-7df632477129 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:08 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782e4b54-a5f3-478c-b584-7c9d6d983807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fcee80-87cf-4c5b-9d99-b43623ce8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:08 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 1073741824 Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=251,cinder:UPDATE=355,cinder:DELETE=29,cinder:INSERT=96 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:36:08 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:08 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Volume volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b (833198ed-3a9a-4bf6-85ce-ff49f378ca4b): created successfully Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fcee80-87cf-4c5b-9d99-b43623ce8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Flow 'volume_create_manager' (0c7f0427-61c2-46a0-8dc3-c4d17e5ad00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-97968307-24bd-45f3-bdf9-68bb5dea8d8d tempest-CinderUnicodeTest-1578056727 None] Created volume successfully. Sep 02 16:36:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:09 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 1073741824" returned: 0 in 0.512s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:09 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 Sep 02 16:36:09 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:09 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129" returned: 0 in 0.319s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442c44a-352e-4434-88ac-91340ec74c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e696061-5300-48f1-b31d-7df632477129', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a04c9e-0412-4510-92b6-700f70b9b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Creating offline snapshot 1928a52c-540d-4286-8177-4f5eef186ccd of volume ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:09 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Volume volume-6e696061-5300-48f1-b31d-7df632477129 (6e696061-5300-48f1-b31d-7df632477129): created successfully Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a04c9e-0412-4510-92b6-700f70b9b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (d5889ba2-e253-4ef2-85a9-07c0ddd24e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dafed0-2d62-4dc4-be9d-6db09a50c719]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:09 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:09 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ba91176a-80de-43fe-8c65-4e5a112d15d8 tempest-ProjectReaderTests-1163822184 None] Created volume successfully. Sep 02 16:36:09 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd Sep 02 16:36:09 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:10 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:10 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd 1G Sep 02 16:36:10 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:10 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd 1G" returned: 0 in 0.393s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5ca028-3d22-4c22-ab18-cd23426018cd -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:10 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5ca028-3d22-4c22-ab18-cd23426018cd -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd Sep 02 16:36:10 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:10 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5ca028-3d22-4c22-ab18-cd23426018cd -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd" returned: 0 in 0.296s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:10 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd is being set with open permissions: ugo+rw Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-6e696061-5300-48f1-b31d-7df632477129-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:10 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd Sep 02 16:36:10 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "cinder-6e696061-5300-48f1-b31d-7df632477129-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-quobyte-6e696061-5300-48f1-b31d-7df632477129" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-6e696061-5300-48f1-b31d-7df632477129" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b813adc9-a885-4eb1-8515-1ff058a9823b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 Sep 02 16:36:11 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:11 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd" returned: 0 in 0.286s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info Sep 02 16:36:11 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:11 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129" returned: 0 in 0.416s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129 Sep 02 16:36:11 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:11 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info" returned: 0 in 0.270s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:11 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info is being set with open permissions: ugo+rw Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info Sep 02 16:36:11 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:11 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6e696061-5300-48f1-b31d-7df632477129" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-6e696061-5300-48f1-b31d-7df632477129" released by "delete_volume" :: held 0.732s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:11 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.info" returned: 0 in 0.281s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.072s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Creating offline snapshot 77f3277f-54fe-489a-a979-c1245e4ab670 of volume 833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Created reservations ['25d267d6-9b3f-46cb-99d5-2c01e4449452', '1c9e8607-92d7-4362-a7a3-efec0816930e', 'a9ca3fa7-d639-43ee-b590-81b237975911', 'd5685dbd-df5d-492f-b0ef-ad49f27ba51a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f46dd7a5-943c-4409-baee-9515ff406acb tempest-ProjectReaderTests-303186967 None] Create snapshot completed successfully Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d425589-6575-4c73-979d-6e592f31d485]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:11 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:11 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:11 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b Sep 02 16:36:11 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:12 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.359s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:12 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Deleted volume successfully. Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-f44862b8-fb55-4b17-90c0-3f0523dd45eb tempest-ProjectReaderTests-1163822184 None] Lock "cinder-6e696061-5300-48f1-b31d-7df632477129-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:12 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" returned: 0 in 0.535s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-1928a52c-540d-4286-8177-4f5eef186ccd-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-1928a52c-540d-4286-8177-4f5eef186ccd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:12 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 1G Sep 02 16:36:12 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-1928a52c-540d-4286-8177-4f5eef186ccd" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-1928a52c-540d-4286-8177-4f5eef186ccd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Deleting offline snapshot 1928a52c-540d-4286-8177-4f5eef186ccd of volume ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] snapshot_file for this snap is: volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40b86b5-76bd-4048-80a5-4e158d480764]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:12 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd Sep 02 16:36:12 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (8bd2edf4-5d10-4a8f-870c-ebad0ef3c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ea3ac0-423a-4f04-80ea-53eb7f72f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ea3ac0-423a-4f04-80ea-53eb7f72f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895757794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949ee72a-2940-4ce3-95c2-d5cc45533620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:12Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d11fd5-eab7-4d63-808d-ff4db3c648f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d11fd5-eab7-4d63-808d-ff4db3c648f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f6b53c-7571-40d9-8e2d-e35ed2928f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f6b53c-7571-40d9-8e2d-e35ed2928f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949ee72a-2940-4ce3-95c2-d5cc45533620', 'volume_name': 'volume-949ee72a-2940-4ce3-95c2-d5cc45533620', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa287e9-5247-4bc2-bb11-45aac27de402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa287e9-5247-4bc2-bb11-45aac27de402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b36641d-0622-41d6-8ae0-16144322c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:12 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Volume 949ee72a-2940-4ce3-95c2-d5cc45533620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949ee72a-2940-4ce3-95c2-d5cc45533620', 'volume_size': 1} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:12 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 1G" returned: 0 in 0.483s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:12 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 Sep 02 16:36:12 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:12 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5ca028-3d22-4c22-ab18-cd23426018cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[390bc1aa-21c1-4edb-b6fe-0b9043e4e4a8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:12 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd Sep 02 16:36:12 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670" returned: 0 in 0.288s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 is being set with open permissions: ugo+rw Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:13 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 Sep 02 16:36:13 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd" returned: 0 in 0.395s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:13 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd Sep 02 16:36:13 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:13 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info Sep 02 16:36:13 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:13 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd Sep 02 16:36:13 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info" returned: 0 in 0.294s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info is being set with open permissions: ugo+rw Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:13 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info Sep 02 16:36:13 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:13 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd.1928a52c-540d-4286-8177-4f5eef186ccd" returned: 0 in 0.303s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-1928a52c-540d-4286-8177-4f5eef186ccd" released by "_delete_snapshot" :: held 1.615s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:13 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" released by "delete_snapshot" :: held 1.640s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.info" returned: 0 in 0.304s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895757794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949ee72a-2940-4ce3-95c2-d5cc45533620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c4485b61aa44aaa86d83ad9c4d7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:12Z,use_quota=True,user_id='8ed6f673e06149aa9c6dba0020572cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Creating volume 949ee72a-2940-4ce3-95c2-d5cc45533620 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:14 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:14 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 1073741824 Sep 02 16:36:14 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-14824152-fef9-4659-a48a-186ffb677fe3 tempest-CinderUnicodeTest-1578056727 None] Create snapshot completed successfully Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Created reservations ['bbefa279-ecf8-4e36-a9f1-6ddea8f71f5a', 'fb7601e0-278a-4c1f-8231-993f2b111790', 'f3e301fc-e0ed-45e3-80ad-fdacde99af83', '7ddf3f74-d382-45ad-bbd3-a748b822eeb9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Delete snapshot completed successfully. Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-509ad7b7-652c-40ee-b694-ed9e2b89ee45 tempest-ProjectReaderTests-303186967 None] Lock "cinder-1928a52c-540d-4286-8177-4f5eef186ccd-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-ee5ca028-3d22-4c22-ab18-cd23426018cd-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "cinder-ee5ca028-3d22-4c22-ab18-cd23426018cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:14 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 1073741824" returned: 0 in 0.477s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Acquiring lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a1cda-7c09-41ed-a6ba-468aa76d01c6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:14 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 Sep 02 16:36:14 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:14 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd Sep 02 16:36:14 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:14 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b36641d-0622-41d6-8ae0-16144322c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949ee72a-2940-4ce3-95c2-d5cc45533620', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a180e93d-cc9a-44ad-aacb-1cabe563c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-77f3277f-54fe-489a-a979-c1245e4ab670-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Volume volume-949ee72a-2940-4ce3-95c2-d5cc45533620 (949ee72a-2940-4ce3-95c2-d5cc45533620): created successfully Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a180e93d-cc9a-44ad-aacb-1cabe563c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Flow 'volume_create_manager' (8bd2edf4-5d10-4a8f-870c-ebad0ef3c246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-77f3277f-54fe-489a-a979-c1245e4ab670-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b7134d06-1af7-43c3-af98-9f2c9aef50f2 tempest-ProjectReaderTests-1163822184 None] Created volume successfully. Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:14 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-quobyte-77f3277f-54fe-489a-a979-c1245e4ab670" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-77f3277f-54fe-489a-a979-c1245e4ab670" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Deleting offline snapshot 77f3277f-54fe-489a-a979-c1245e4ab670 of volume 833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] snapshot_file for this snap is: volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c60ce5-f1e8-4235-923a-40183fddb089]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:15 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd" returned: 0 in 0.476s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:15 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd Sep 02 16:36:15 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:15 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 Sep 02 16:36:15 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:15 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ee5ca028-3d22-4c22-ab18-cd23426018cd" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "cinder-quobyte-ee5ca028-3d22-4c22-ab18-cd23426018cd" released by "delete_volume" :: held 0.862s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Created reservations ['0001b177-ce3d-42a5-b47e-d4bb5491f9ab', '67ad12ae-8367-4833-920d-ff7a18d556d7', 'e913a1d3-a262-4b89-a91f-6959fb6f1f66', '6933f346-f242-4cec-b8ef-adc40fb1a2fc'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:15 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670" returned: 0 in 0.509s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:15 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:15 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2b1c2-7e5c-4737-8980-dab75e61eb65]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-949ee72a-2940-4ce3-95c2-d5cc45533620-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "cinder-949ee72a-2940-4ce3-95c2-d5cc45533620-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Acquiring lock "cinder-quobyte-949ee72a-2940-4ce3-95c2-d5cc45533620" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-949ee72a-2940-4ce3-95c2-d5cc45533620" acquired by "delete_volume" :: waited 0.039s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11f3495-4959-48c9-b8c4-f93dc968fe5b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:15 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b Sep 02 16:36:15 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:15 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Deleted volume successfully. Sep 02 16:36:15 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-97f2018f-6e7e-44db-a135-a17dad89ec37 tempest-ProjectReaderTests-303186967 None] Lock "cinder-ee5ca028-3d22-4c22-ab18-cd23426018cd-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:16 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 Sep 02 16:36:16 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:16 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" returned: 0 in 0.550s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:16 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 Sep 02 16:36:16 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:16 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620" returned: 0 in 0.475s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:16 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620 Sep 02 16:36:16 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:16 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670" returned: 0 in 0.432s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-949ee72a-2940-4ce3-95c2-d5cc45533620" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "cinder-quobyte-949ee72a-2940-4ce3-95c2-d5cc45533620" released by "delete_volume" :: held 0.837s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:16 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670 Sep 02 16:36:16 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Created reservations ['8b177911-977a-4293-b687-19587381d1a8', '3ee5b950-c46b-4f0c-b3e4-9c7cc37e6005', '70d4221b-d343-4947-9738-d5e2227880e8', '053a50b5-c3e4-4f92-8414-0a8f18fd1431'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:16 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:16 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:17 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b.77f3277f-54fe-489a-a979-c1245e4ab670" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-77f3277f-54fe-489a-a979-c1245e4ab670" released by "_delete_snapshot" :: held 2.108s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" released by "delete_snapshot" :: held 2.151s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Created reservations ['c5127df1-6dfc-46ad-b49b-5ee3f1aeb4cb', '0307763f-9a4c-443c-bbd2-e4d2482fc507', 'f892e718-2b96-4bf7-b2f4-63a7af3d8b61', '22f6e78c-05a8-449d-802e-2db6b48e701b'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:17 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Deleted volume successfully. Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-85ebb244-fdb6-4848-a2e4-eadd6edea66f tempest-ProjectReaderTests-1163822184 None] Lock "cinder-949ee72a-2940-4ce3-95c2-d5cc45533620-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Delete snapshot completed successfully. Sep 02 16:36:17 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-bcd191bf-7579-49fe-b1a0-f517bafbe486 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-77f3277f-54fe-489a-a979-c1245e4ab670-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-833198ed-3a9a-4bf6-85ce-ff49f378ca4b-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-833198ed-3a9a-4bf6-85ce-ff49f378ca4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" acquired by "delete_volume" :: waited 0.027s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ac0f2-6574-4cf5-8a62-990f86adffb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:18 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b Sep 02 16:36:18 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:18 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" returned: 0 in 0.487s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:18 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b Sep 02 16:36:18 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:19 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" returned: 0 in 0.355s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-833198ed-3a9a-4bf6-85ce-ff49f378ca4b" released by "delete_volume" :: held 0.934s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Created reservations ['f42c29a9-9480-4d2e-948b-321072ba58f3', '839b0468-4e8f-48c5-a364-37552efa5d55', '2eb496b3-f3a6-47ef-a4a0-4867a8cae468', '9be936fe-7619-4694-ba8c-d8de43bd3747'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:19 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:19 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:19 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.274s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Deleted volume successfully. Sep 02 16:36:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-92158a4f-2135-489d-9a2f-76a1d5f7f040 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-833198ed-3a9a-4bf6-85ce-ff49f378ca4b-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-2722e66d-c26b-4052-a335-7157cf1090f9-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-2722e66d-c26b-4052-a335-7157cf1090f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "cinder-quobyte-2722e66d-c26b-4052-a335-7157cf1090f9" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-2722e66d-c26b-4052-a335-7157cf1090f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9505c-20e6-4bb3-a7e5-8a1fad8c1a7d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:20 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 Sep 02 16:36:20 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:21 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:21 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9 Sep 02 16:36:21 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:21 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-2722e66d-c26b-4052-a335-7157cf1090f9" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-quobyte-2722e66d-c26b-4052-a335-7157cf1090f9" released by "delete_volume" :: held 0.678s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Created reservations ['96d425db-2d16-472b-874d-8f5da8e9257d', '96716e8c-5eba-4da8-a0f4-e31fe88e25fd', '9563a1cd-d600-45ef-a8cf-868e5ae24cb2', '3443bb3d-217d-43ed-b96f-fd2544732292'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:21 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:21 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:21 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.295s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Deleted volume successfully. Sep 02 16:36:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-910aa4d5-48f5-4e23-9d33-9d189484eae8 tempest-CinderUnicodeTest-1578056727 None] Lock "cinder-2722e66d-c26b-4052-a335-7157cf1090f9-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (8df487f6-a79d-44a3-b444-4765d420d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5749581d-924f-4b0b-a47d-b0e853bef013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5749581d-924f-4b0b-a47d-b0e853bef013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716264807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb32170-64ff-4ab3-a295-c1f764ca9b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:30Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8908d7a-7b5d-4877-8735-f9b5f5cd13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8908d7a-7b5d-4877-8735-f9b5f5cd13fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c8533-cda9-4478-a348-f68d8f588c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c8533-cda9-4478-a348-f68d8f588c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb32170-64ff-4ab3-a295-c1f764ca9b7a', 'volume_name': 'volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8ff4a8-0319-4dac-ad0c-4c7a0f778e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8ff4a8-0319-4dac-ad0c-4c7a0f778e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e780f-9627-4f69-bfba-e6a9cc14e557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:30 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Volume 6bb32170-64ff-4ab3-a295-c1f764ca9b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a', 'volume_size': 1} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716264807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb32170-64ff-4ab3-a295-c1f764ca9b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:30Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Creating volume 6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:30 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:30 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a 1073741824 Sep 02 16:36:30 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:31 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a 1073741824" returned: 0 in 0.445s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:31 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a Sep 02 16:36:31 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:31 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e780f-9627-4f69-bfba-e6a9cc14e557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90b778b-e974-4947-8205-0c68f4682f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:31 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Volume volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a (6bb32170-64ff-4ab3-a295-c1f764ca9b7a): created successfully Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90b778b-e974-4947-8205-0c68f4682f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (8df487f6-a79d-44a3-b444-4765d420d42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ad41d762-fa08-4212-89b2-f280ab3303d1 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot dad74607-85c0-4597-8baa-29bb58ba8df9 of volume 6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[785bea67-93bd-4cb5-bea8-9d4d2edfb3d2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:32 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a Sep 02 16:36:32 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:32 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:32 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 1G Sep 02 16:36:32 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:32 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 1G" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:32 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 Sep 02 16:36:32 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:33 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:33 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 is being set with open permissions: ugo+rw Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:33 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 Sep 02 16:36:33 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:33 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9" returned: 0 in 0.252s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:33 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info Sep 02 16:36:33 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:33 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info" returned: 0 in 0.255s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:33 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info is being set with open permissions: ugo+rw Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:33 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info Sep 02 16:36:33 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:33 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.info" returned: 0 in 0.239s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4b2d3ec2-d265-4509-8b0d-fe404d384b77 tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:36:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-dad74607-85c0-4597-8baa-29bb58ba8df9-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-dad74607-85c0-4597-8baa-29bb58ba8df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-dad74607-85c0-4597-8baa-29bb58ba8df9" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-dad74607-85c0-4597-8baa-29bb58ba8df9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot dad74607-85c0-4597-8baa-29bb58ba8df9 of volume 6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[926deb90-24d1-4101-8cfa-7b7fdde888c4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:34 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 Sep 02 16:36:34 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:34 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267e9e0-a686-4724-b8a6-fd35093fc856]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:34 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a Sep 02 16:36:34 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:34 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:34 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 Sep 02 16:36:34 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:35 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9" returned: 0 in 0.362s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:35 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9 Sep 02 16:36:35 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:35 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a.dad74607-85c0-4597-8baa-29bb58ba8df9" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-dad74607-85c0-4597-8baa-29bb58ba8df9" released by "_delete_snapshot" :: held 1.474s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" released by "delete_snapshot" :: held 1.497s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Created reservations ['58d239d2-1010-49f7-9954-4dbcb5374853', 'f3a29d9c-95a9-4610-aac8-bb7b32f7c80c', '3df7988b-ae8f-4fce-a035-c2468192f141', 'c103e8e4-668a-499d-b879-6a41a42a24de'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:35 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:36:35 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-1c2552b8-2da6-464f-87ce-638898f21dac tempest-ProjectMemberTests-1462193155 None] Lock "cinder-dad74607-85c0-4597-8baa-29bb58ba8df9-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-6bb32170-64ff-4ab3-a295-c1f764ca9b7a-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "cinder-6bb32170-64ff-4ab3-a295-c1f764ca9b7a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4493ad-35fe-4e51-bb7f-f65d612bf44d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:36 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a Sep 02 16:36:36 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:36 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:36 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a Sep 02 16:36:36 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:36 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:36 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-6bb32170-64ff-4ab3-a295-c1f764ca9b7a" released by "delete_volume" :: held 0.721s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Created reservations ['e172b5bf-9efa-4dfc-822b-94fe9fd90dfb', '00c085c3-9afe-440f-a4c3-ae801ba970e4', '66a89a36-d372-479d-8b9a-ab8da3302f14', '9546d329-9d31-487e-9cf8-ee0effbb7c33'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:37 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:37 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:37 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:37 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-6a6e2b5a-f013-4455-8a7c-b5465eb21bcb tempest-ProjectMemberTests-1462193155 None] Lock "cinder-6bb32170-64ff-4ab3-a295-c1f764ca9b7a-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (1805bbd3-b920-4e08-939c-2aa73e0d3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47de989b-78a8-4924-8680-44285fab03c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47de989b-78a8-4924-8680-44285fab03c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866952049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fe80ed-39b9-4473-a037-4e3338f9ebbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:38Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8537b73e-791b-451b-91ad-fe6c1f352a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8537b73e-791b-451b-91ad-fe6c1f352a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c3380-c3a1-4317-b6c8-5f2393879f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c3380-c3a1-4317-b6c8-5f2393879f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fe80ed-39b9-4473-a037-4e3338f9ebbf', 'volume_name': 'volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12b3c8-ab0b-431d-b0ec-f1b3d243e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12b3c8-ab0b-431d-b0ec-f1b3d243e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42deae41-2f39-401f-8dbd-9e9979ba9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:37 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Volume a8fe80ed-39b9-4473-a037-4e3338f9ebbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf', 'volume_size': 1} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866952049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fe80ed-39b9-4473-a037-4e3338f9ebbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:38Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Creating volume a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:37 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:37 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf 1073741824 Sep 02 16:36:37 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:38 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf 1073741824" returned: 0 in 0.434s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:38 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf Sep 02 16:36:38 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:38 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" returned: 0 in 0.279s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42deae41-2f39-401f-8dbd-9e9979ba9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923136de-1b3c-4dcd-98e8-b69c205c86d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Flow 'volume_create_manager' (4dbc21a5-0083-4c1d-abcb-19a1f215dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76710ae1-ae3c-47de-acc6-0361e5c3df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Volume volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf (a8fe80ed-39b9-4473-a037-4e3338f9ebbf): created successfully Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923136de-1b3c-4dcd-98e8-b69c205c86d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (1805bbd3-b920-4e08-939c-2aa73e0d3740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76710ae1-ae3c-47de-acc6-0361e5c3df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031201199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2687dab-f4f5-4f7e-9e74-2a92c1f985d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7b9e8e56df4934859646c10d912fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:39Z,use_quota=True,user_id='5d4e8ba73a084305b224a5c13028e768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfa2b99-5db3-449e-9b45-a11692363ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfa2b99-5db3-449e-9b45-a11692363ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d1c621-b13e-41e0-b826-753fd187ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d1c621-b13e-41e0-b826-753fd187ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2687dab-f4f5-4f7e-9e74-2a92c1f985d3', 'volume_name': 'volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408de036-7fee-4ecb-b9e5-2f6768e109db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408de036-7fee-4ecb-b9e5-2f6768e109db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9cd3ef-9d46-42b3-b345-3d5137153c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:38 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Volume a2687dab-f4f5-4f7e-9e74-2a92c1f985d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3', 'volume_size': 1} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031201199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2687dab-f4f5-4f7e-9e74-2a92c1f985d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7b9e8e56df4934859646c10d912fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:39Z,use_quota=True,user_id='5d4e8ba73a084305b224a5c13028e768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Creating volume a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:38 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5a4c67cf-a78a-4661-8166-03f5e60c50e6 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:36:38 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 1073741824 Sep 02 16:36:38 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:39 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 1073741824" returned: 0 in 0.399s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:39 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 Sep 02 16:36:39 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:39 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9cd3ef-9d46-42b3-b345-3d5137153c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8bdfe8-4d7f-46dc-8736-8a26056efb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:39 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Volume volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 (a2687dab-f4f5-4f7e-9e74-2a92c1f985d3): created successfully Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8bdfe8-4d7f-46dc-8736-8a26056efb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Flow 'volume_create_manager' (4dbc21a5-0083-4c1d-abcb-19a1f215dc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4f4a8ef2-c6a4-432d-a187-b912835340e6 tempest-ProjectReaderTests-1446853300 None] Created volume successfully. Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Acquiring lock "cinder-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "cinder-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Acquiring lock "cinder-quobyte-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "cinder-quobyte-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b3162-7c24-4721-bcc7-4f9317349458]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 Sep 02 16:36:40 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot d4baeeaa-dcb4-4b64-8c35-691836b274a3 of volume a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9cacf-8a42-44af-be89-8c904d3817a7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf Sep 02 16:36:40 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" returned: 0 in 0.374s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3 Sep 02 16:36:40 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" returned: 0 in 0.388s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 1G Sep 02 16:36:40 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "cinder-quobyte-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3" released by "delete_volume" :: held 0.681s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Created reservations ['519257b2-ec34-417d-a563-a6a1e68b344c', '9f61e00c-33a6-4d30-8b4a-619f7cfb3fbf', '7322ac36-189d-4f6f-a188-89bb1459acbf', 'ddf5f8e7-a703-4d9a-ba15-f08604c91b19'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:40 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 1G" returned: 0 in 0.406s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:40 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 Sep 02 16:36:40 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:40 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.270s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:40 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Deleted volume successfully. Sep 02 16:36:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a4489d99-f00f-46c7-8046-12084ad4ab8e tempest-ProjectReaderTests-1446853300 None] Lock "cinder-a2687dab-f4f5-4f7e-9e74-2a92c1f985d3-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:41 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3" returned: 0 in 0.327s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:41 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 is being set with open permissions: ugo+rw Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:41 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 Sep 02 16:36:41 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Flow 'volume_create_manager' (36763e6a-2c32-4160-8d7c-b498b7f8d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400d234-861b-48a3-8793-c3884f9e2272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400d234-861b-48a3-8793-c3884f9e2272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068500579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bfd1af-48a7-4aad-8e79-1721381cc6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7b9e8e56df4934859646c10d912fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:41Z,use_quota=True,user_id='5d4e8ba73a084305b224a5c13028e768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810c9cbb-eb10-4e71-828b-34a9e01dc18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:41 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810c9cbb-eb10-4e71-828b-34a9e01dc18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b7ab9-b6ac-44bb-8424-96c5b8f1eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b7ab9-b6ac-44bb-8424-96c5b8f1eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bfd1af-48a7-4aad-8e79-1721381cc6da', 'volume_name': 'volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fd4c3f-bafa-4bab-ba35-6e6a1cfbdf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fd4c3f-bafa-4bab-ba35-6e6a1cfbdf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7d0d37-d773-4d62-ada4-94cde6f2e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:41 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Volume e9bfd1af-48a7-4aad-8e79-1721381cc6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da', 'volume_size': 1} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:41 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info Sep 02 16:36:41 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:41 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:41 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info is being set with open permissions: ugo+rw Sep 02 16:36:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:41 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info Sep 02 16:36:41 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:42 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.info" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068500579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bfd1af-48a7-4aad-8e79-1721381cc6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7b9e8e56df4934859646c10d912fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:41Z,use_quota=True,user_id='5d4e8ba73a084305b224a5c13028e768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Creating volume e9bfd1af-48a7-4aad-8e79-1721381cc6da {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:42 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:42 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da 1073741824 Sep 02 16:36:42 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-414e12b7-8c44-450c-8ae1-045ea99a1c3a tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:36:42 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da 1073741824" returned: 0 in 0.431s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:42 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da Sep 02 16:36:42 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:42 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da" returned: 0 in 0.251s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7d0d37-d773-4d62-ada4-94cde6f2e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b30d13-4931-43ef-82a6-26f8dacde0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Volume volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da (e9bfd1af-48a7-4aad-8e79-1721381cc6da): created successfully Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b30d13-4931-43ef-82a6-26f8dacde0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Flow 'volume_create_manager' (36763e6a-2c32-4160-8d7c-b498b7f8d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-84b5f9ef-4c91-42a1-acf5-1958f4e66269 tempest-ProjectReaderTests-1446853300 None] Created volume successfully. Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-d4baeeaa-dcb4-4b64-8c35-691836b274a3-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-d4baeeaa-dcb4-4b64-8c35-691836b274a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-d4baeeaa-dcb4-4b64-8c35-691836b274a3" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d4baeeaa-dcb4-4b64-8c35-691836b274a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot d4baeeaa-dcb4-4b64-8c35-691836b274a3 of volume a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af7447-4756-468b-95d9-21c603c93e7c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:43 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 Sep 02 16:36:43 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Acquiring lock "cinder-e9bfd1af-48a7-4aad-8e79-1721381cc6da-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "cinder-e9bfd1af-48a7-4aad-8e79-1721381cc6da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Acquiring lock "cinder-quobyte-e9bfd1af-48a7-4aad-8e79-1721381cc6da" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "cinder-quobyte-e9bfd1af-48a7-4aad-8e79-1721381cc6da" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:43 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b8bc71-c8a7-4d67-9b07-ff923dde50cd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3" returned: 0 in 0.400s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b0a10-799b-422f-806e-d8da07a89894]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:43 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da Sep 02 16:36:43 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:43 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf Sep 02 16:36:43 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:44 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:44 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da Sep 02 16:36:44 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:44 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" returned: 0 in 0.360s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:44 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 Sep 02 16:36:44 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:44 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-e9bfd1af-48a7-4aad-8e79-1721381cc6da" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "cinder-quobyte-e9bfd1af-48a7-4aad-8e79-1721381cc6da" released by "delete_volume" :: held 0.665s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Created reservations ['e137468a-f2ac-414e-b7db-74b37d2c5ae9', 'c81c5085-508e-4c56-bc28-3432fa1c9e79', '92868828-f1fc-4bfe-82bd-45f573dc73b0', '05ff98a9-67f6-4c1d-a07c-54140081e103'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:44 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3" returned: 0 in 0.364s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:44 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:44 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:44 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3 Sep 02 16:36:44 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:44 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.240s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Deleted volume successfully. Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-7f235d14-9db4-4bc1-af43-9e0934efcc5d tempest-ProjectReaderTests-1446853300 None] Lock "cinder-e9bfd1af-48a7-4aad-8e79-1721381cc6da-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:44 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf.d4baeeaa-dcb4-4b64-8c35-691836b274a3" returned: 0 in 0.276s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d4baeeaa-dcb4-4b64-8c35-691836b274a3" released by "_delete_snapshot" :: held 1.516s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" released by "delete_snapshot" :: held 1.543s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Created reservations ['5a1455b4-e718-4c47-9248-03c5c45bef0f', 'e193bfa9-4e3b-40e6-8cad-645f46af7f83', '4bbb9a86-db80-4b7d-a853-f8d01e0bc6bd', 'd916db8b-127f-43a4-ab5e-dbb667721046'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:44 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:36:44 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-889e31d7-7b97-4e0e-b155-538970247c02 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-d4baeeaa-dcb4-4b64-8c35-691836b274a3-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-a8fe80ed-39b9-4473-a037-4e3338f9ebbf-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-a8fe80ed-39b9-4473-a037-4e3338f9ebbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" acquired by "delete_volume" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e201f3-2f35-4fd7-a8fd-4708962c5969]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:45 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf Sep 02 16:36:45 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:45 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:45 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf Sep 02 16:36:45 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:46 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" returned: 0 in 0.274s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-a8fe80ed-39b9-4473-a037-4e3338f9ebbf" released by "delete_volume" :: held 0.740s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Created reservations ['bb4752e6-3378-4d7a-9da6-feff976b1d87', 'a84eb545-f49e-4a23-87a8-c9bdfd2fe90b', 'd1819736-d7d6-4c7e-8322-533610537578', 'cc2fdc07-7590-463f-816a-3fb130e5166c'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:46 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:46 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:46 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.285s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:36:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-a74a1449-9646-4d94-adb9-a1b01a56c620 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-a8fe80ed-39b9-4473-a037-4e3338f9ebbf-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (9562b49a-9add-45da-b001-6bb672d0b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc73050a-a98b-4c46-af68-ada4f1835474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc73050a-a98b-4c46-af68-ada4f1835474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813235930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb3065d-6230-40d6-b1dd-38553db4c5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:47Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a342b-e0bc-4ce2-b2ea-a696cf619380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a342b-e0bc-4ce2-b2ea-a696cf619380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0573e3bb-2926-455a-a870-764537fa3bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0573e3bb-2926-455a-a870-764537fa3bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb3065d-6230-40d6-b1dd-38553db4c5e9', 'volume_name': 'volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f0fec-3902-4beb-9425-991a6dbbcf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56f0fec-3902-4beb-9425-991a6dbbcf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79297c5a-2c19-4b92-94b5-6ca7e3eaaa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Volume 3bb3065d-6230-40d6-b1dd-38553db4c5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9', 'volume_size': 1} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813235930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb3065d-6230-40d6-b1dd-38553db4c5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:47Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Creating volume 3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:47 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:47 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 1073741824 Sep 02 16:36:47 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:47 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 1073741824" returned: 0 in 0.439s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:47 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 Sep 02 16:36:47 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:47 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79297c5a-2c19-4b92-94b5-6ca7e3eaaa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:47 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0c78de-ddf8-4077-8c5a-84cada575810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:47 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Volume volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 (3bb3065d-6230-40d6-b1dd-38553db4c5e9): created successfully Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0c78de-ddf8-4077-8c5a-84cada575810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (9562b49a-9add-45da-b001-6bb672d0b61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ea0e353d-2cd1-40fc-8a36-40c9f3d9e5d4 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:48 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:48 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:48 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.268s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:36:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot 0ae2ae34-4ef5-4692-85c9-eea4831146b1 of volume 3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96d500-a0c1-4adb-a284-718474aef14c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:49 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 Sep 02 16:36:49 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:49 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9" returned: 0 in 0.373s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:49 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:49 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 1G Sep 02 16:36:49 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:50 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 1G" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:50 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 Sep 02 16:36:50 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:50 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1" returned: 0 in 0.333s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:50 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 is being set with open permissions: ugo+rw Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:50 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 Sep 02 16:36:50 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:50 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:50 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info Sep 02 16:36:50 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:51 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info" returned: 0 in 0.291s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:51 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info is being set with open permissions: ugo+rw Sep 02 16:36:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:51 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info Sep 02 16:36:51 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:51 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.info" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:51 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:51 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7638ad8b-d43a-41aa-a81f-9a4a4e948cb4 tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-0ae2ae34-4ef5-4692-85c9-eea4831146b1-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-0ae2ae34-4ef5-4692-85c9-eea4831146b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-0ae2ae34-4ef5-4692-85c9-eea4831146b1" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-0ae2ae34-4ef5-4692-85c9-eea4831146b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot 0ae2ae34-4ef5-4692-85c9-eea4831146b1 of volume 3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc485e-fde1-4e0d-b9de-a1fda8fc2ddf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:52 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:52 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 Sep 02 16:36:52 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:53 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1" returned: 0 in 0.391s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c3b79-e3a3-40d2-aa3a-ab023707066c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:53 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 Sep 02 16:36:53 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:53 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9" returned: 0 in 0.390s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:53 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 Sep 02 16:36:53 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:53 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1" returned: 0 in 0.361s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:53 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:53 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1 Sep 02 16:36:53 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:54 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9.0ae2ae34-4ef5-4692-85c9-eea4831146b1" returned: 0 in 0.293s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-0ae2ae34-4ef5-4692-85c9-eea4831146b1" released by "_delete_snapshot" :: held 1.536s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" released by "delete_snapshot" :: held 1.563s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Created reservations ['fde0cfca-8bd2-44ac-9ff2-1353dfc3ee3a', 'ca34d91b-22cc-44ab-a9b2-a8096987e337', '6678cb54-c4fd-4564-8145-3fad60b289de', '51f80b4b-20d4-4390-9ee5-3cbed389d0ec'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:54 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-25fa9731-ec82-41d9-8cf7-e472e3884571 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-0ae2ae34-4ef5-4692-85c9-eea4831146b1-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-3bb3065d-6230-40d6-b1dd-38553db4c5e9-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-3bb3065d-6230-40d6-b1dd-38553db4c5e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c7e7e4-542d-4a69-89e3-7109215300a9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:54 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:54 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 Sep 02 16:36:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:55 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:55 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9 Sep 02 16:36:55 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:55 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3bb3065d-6230-40d6-b1dd-38553db4c5e9" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-3bb3065d-6230-40d6-b1dd-38553db4c5e9" released by "delete_volume" :: held 0.724s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Created reservations ['13e9bc46-0571-46e2-b3b4-024c807d3612', '30171166-b9c8-4859-9a7e-76037b5cb2d4', 'baa1ff6d-ca39-4eba-a2ba-2ca303be12a6', 'f72a70a7-d951-4221-b8f3-6d86e9175c00'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:55 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:36:55 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:55 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:55 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:36:55 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-c7ac994f-a51b-484a-8917-83113e77e078 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-3bb3065d-6230-40d6-b1dd-38553db4c5e9-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (4f461f56-99f4-4dd1-b399-3a86c065248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866b3f63-d188-4993-8669-666f4bf94ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866b3f63-d188-4993-8669-666f4bf94ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948600435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a0b0b-f349-4009-816b-db263a55279e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:56Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0054450-460d-4dcc-9fa1-61649add4171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0054450-460d-4dcc-9fa1-61649add4171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494caf0-6b26-427d-829b-1f12b0264453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494caf0-6b26-427d-829b-1f12b0264453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1a0b0b-f349-4009-816b-db263a55279e', 'volume_name': 'volume-ed1a0b0b-f349-4009-816b-db263a55279e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320e7e0f-4ea5-4d22-b54b-e4b4acc3e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320e7e0f-4ea5-4d22-b54b-e4b4acc3e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a416b-df43-4a65-95fc-3b1dd1002346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:56 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Volume ed1a0b0b-f349-4009-816b-db263a55279e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1a0b0b-f349-4009-816b-db263a55279e', 'volume_size': 1} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948600435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a0b0b-f349-4009-816b-db263a55279e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:36:56Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Creating volume ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:36:56 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:36:56 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:56 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e 1073741824 Sep 02 16:36:56 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:57 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e 1073741824" returned: 0 in 0.566s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:57 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e Sep 02 16:36:57 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:57 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e" returned: 0 in 0.270s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a416b-df43-4a65-95fc-3b1dd1002346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1a0b0b-f349-4009-816b-db263a55279e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b31acd8-5eb5-4238-95d4-a1677e44e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:36:57 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Volume volume-ed1a0b0b-f349-4009-816b-db263a55279e (ed1a0b0b-f349-4009-816b-db263a55279e): created successfully Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b31acd8-5eb5-4238-95d4-a1677e44e576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:36:57 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (4f461f56-99f4-4dd1-b399-3a86c065248f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:36:57 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9cf71960-e13c-4518-8bdd-89d1290e706e tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:36:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:36:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:36:58 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot be62ac41-e9e1-41d1-9477-e05fce09da6e of volume ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:36:58 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140c5f7-5397-40cc-aa80-1dbade594c3d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:36:58 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:58 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e Sep 02 16:36:58 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:59 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:59 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e 1G Sep 02 16:36:59 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:59 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e 1G" returned: 0 in 0.423s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a0b0b-f349-4009-816b-db263a55279e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:59 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a0b0b-f349-4009-816b-db263a55279e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e Sep 02 16:36:59 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:36:59 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a0b0b-f349-4009-816b-db263a55279e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:36:59 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e is being set with open permissions: ugo+rw Sep 02 16:36:59 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:36:59 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e Sep 02 16:36:59 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:00 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e" returned: 0 in 0.252s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:00 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info Sep 02 16:37:00 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:00 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info" returned: 0 in 0.277s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:00 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info is being set with open permissions: ugo+rw Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:00 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info Sep 02 16:37:00 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:00 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.info" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:00 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:00 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-1f9621d8-0ebf-401b-bdf0-e03aa3c76294 tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-be62ac41-e9e1-41d1-9477-e05fce09da6e-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-be62ac41-e9e1-41d1-9477-e05fce09da6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-be62ac41-e9e1-41d1-9477-e05fce09da6e" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-be62ac41-e9e1-41d1-9477-e05fce09da6e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot be62ac41-e9e1-41d1-9477-e05fce09da6e of volume ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4715e-0c5c-4ead-9528-f2b6bd40eac8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:01 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:02 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e Sep 02 16:37:02 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:02 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e" returned: 0 in 0.430s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed1a0b0b-f349-4009-816b-db263a55279e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a2aacc-8e90-444a-9df0-3f07e06431f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:02 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e Sep 02 16:37:02 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:02 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e" returned: 0 in 0.430s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:02 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:02 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e Sep 02 16:37:02 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:03 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e" returned: 0 in 0.352s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:03 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e Sep 02 16:37:03 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:03 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e.be62ac41-e9e1-41d1-9477-e05fce09da6e" returned: 0 in 0.275s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-be62ac41-e9e1-41d1-9477-e05fce09da6e" released by "_delete_snapshot" :: held 1.629s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" released by "delete_snapshot" :: held 1.656s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Created reservations ['bdf33725-e9bf-49f1-8ab4-70f98e78c4c6', '41b05353-4516-4c8d-99ee-9bc30588dc11', '89988c31-e5ad-490d-b78d-049998414a6c', '29a2bf35-9d0a-4725-99b8-f31c51aaab9a'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:03 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-9f3e409f-a199-4cc7-b958-8c2c422879e0 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-be62ac41-e9e1-41d1-9477-e05fce09da6e-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:03 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-ed1a0b0b-f349-4009-816b-db263a55279e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-ed1a0b0b-f349-4009-816b-db263a55279e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741eddd-6eb6-4052-a23a-5f3cfcc5e3e7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:04 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e Sep 02 16:37:04 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:04 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e" returned: 0 in 0.385s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:04 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e Sep 02 16:37:04 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:04 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-ed1a0b0b-f349-4009-816b-db263a55279e" returned: 0 in 0.248s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed1a0b0b-f349-4009-816b-db263a55279e" released by "delete_volume" :: held 0.722s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Created reservations ['8a290dea-484d-49c7-aae0-74ac60579d79', 'c2d3be1c-dc74-4dbe-ab4b-6969557fdcba', 'a3ee7754-addc-4470-a7a8-c5866e20287f', '853bfd1e-2c11-488d-bcc3-46a81a088437'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:04 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:04 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:04 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:05 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:05 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-ae80a3a3-4a10-491c-8d79-362a25d134fa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-ed1a0b0b-f349-4009-816b-db263a55279e-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (910d1a6f-650f-4442-a937-363068f5a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7163c878-50f9-445a-ae4d-24fbdb7552c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7163c878-50f9-445a-ae4d-24fbdb7552c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538178407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9387de21-531a-4a9c-b5fe-9f4c5b794087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:06Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949efb6-e266-4d95-9670-2c2042a89195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949efb6-e266-4d95-9670-2c2042a89195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1df05a-f333-4e62-b808-fa5f5cbeca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1df05a-f333-4e62-b808-fa5f5cbeca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9387de21-531a-4a9c-b5fe-9f4c5b794087', 'volume_name': 'volume-9387de21-531a-4a9c-b5fe-9f4c5b794087', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff2e1d3-b5ff-4b36-837b-c02d7d0499cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff2e1d3-b5ff-4b36-837b-c02d7d0499cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0971349-1e53-4f59-a4c5-c16bce2a8b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:05 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Volume 9387de21-531a-4a9c-b5fe-9f4c5b794087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9387de21-531a-4a9c-b5fe-9f4c5b794087', 'volume_size': 1} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538178407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9387de21-531a-4a9c-b5fe-9f4c5b794087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:06Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Creating volume 9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:05 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:05 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:05 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 1073741824 Sep 02 16:37:05 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:06 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 1073741824" returned: 0 in 0.450s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:06 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 Sep 02 16:37:06 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:06 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0971349-1e53-4f59-a4c5-c16bce2a8b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9387de21-531a-4a9c-b5fe-9f4c5b794087', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc5ea8b-0a1a-4eef-8b59-9ebfd25abff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:06 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Volume volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 (9387de21-531a-4a9c-b5fe-9f4c5b794087): created successfully Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc5ea8b-0a1a-4eef-8b59-9ebfd25abff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (910d1a6f-650f-4442-a937-363068f5a004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:06 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-9c153983-76ca-42bf-a285-ef340b94b93d tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot 33c740c7-7a6c-45ea-8313-51d96835cbd9 of volume 9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d56175-1738-4df8-80d7-f39080740eb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:06 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:06 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 Sep 02 16:37:06 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:07 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087" returned: 0 in 0.378s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:07 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 1G Sep 02 16:37:07 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:07 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 1G" returned: 0 in 0.540s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:07 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:07 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 Sep 02 16:37:07 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:08 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9" returned: 0 in 0.321s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:08 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 is being set with open permissions: ugo+rw Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:08 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 Sep 02 16:37:08 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:08 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9" returned: 0 in 0.271s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:08 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info Sep 02 16:37:08 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:08 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info" returned: 0 in 0.283s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:08 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info is being set with open permissions: ugo+rw Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:08 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info Sep 02 16:37:08 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:08 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.info" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=166,cinder:SELECT=127,cinder:DELETE=14,cinder:INSERT=41 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:37:08 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:UPDATE=154,cinder:SELECT=118,cinder:DELETE=13,cinder:INSERT=43 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:37:08 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f1384ddc-d281-44f5-8f85-70fa209c5d1b tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-33c740c7-7a6c-45ea-8313-51d96835cbd9-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-33c740c7-7a6c-45ea-8313-51d96835cbd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-33c740c7-7a6c-45ea-8313-51d96835cbd9" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-33c740c7-7a6c-45ea-8313-51d96835cbd9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot 33c740c7-7a6c-45ea-8313-51d96835cbd9 of volume 9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4befd-5597-4abd-a856-0177ce3a52c0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:10 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 Sep 02 16:37:10 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:10 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9" returned: 0 in 0.380s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9387de21-531a-4a9c-b5fe-9f4c5b794087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b061eeb-f9a1-466b-8781-9224282871c6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:10 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 Sep 02 16:37:10 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:10 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:10 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:10 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 Sep 02 16:37:10 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:11 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9" returned: 0 in 0.370s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:11 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9 Sep 02 16:37:11 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:11 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087.33c740c7-7a6c-45ea-8313-51d96835cbd9" returned: 0 in 0.284s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-33c740c7-7a6c-45ea-8313-51d96835cbd9" released by "_delete_snapshot" :: held 1.524s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" released by "delete_snapshot" :: held 1.552s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Created reservations ['f0f5e170-1a25-4b88-b3ff-183e8cd660de', '93f6395a-08e3-4565-895b-dff22aa514a3', 'db45d54f-8409-4b87-acd1-afd28a1bf0e4', 'bc737b80-4f28-4706-be78-d31a2bf676ec'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:11 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:11 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-2e45d792-1bde-4eb4-b51d-0a3fc380793c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-33c740c7-7a6c-45ea-8313-51d96835cbd9-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-9387de21-531a-4a9c-b5fe-9f4c5b794087-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-9387de21-531a-4a9c-b5fe-9f4c5b794087-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce345104-fddc-48bb-98ea-1295ef0b9312]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:12 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 Sep 02 16:37:12 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:12 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087" returned: 0 in 0.417s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:12 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:12 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087 Sep 02 16:37:12 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:13 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-9387de21-531a-4a9c-b5fe-9f4c5b794087" returned: 0 in 0.257s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-9387de21-531a-4a9c-b5fe-9f4c5b794087" released by "delete_volume" :: held 0.742s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Created reservations ['c7f49c31-070d-4b75-9cfb-f22e5da53cf7', '08b9d95d-1588-4015-be24-4e0eaada4385', '137c6a77-2409-4d8a-987e-b087866785f6', 'd8e839b6-f8b8-4d64-92fa-20ea8722ff3e'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:13 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:13 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:13 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:13 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3e11e4d1-2adf-449a-b070-548a71eec30b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-9387de21-531a-4a9c-b5fe-9f4c5b794087-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Flow 'volume_create_manager' (0f3fa45c-1f60-48cd-bc9a-5d8353815026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4016332d-6259-482b-8ccd-3edac1c90f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4016332d-6259-482b-8ccd-3edac1c90f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-198864831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3145d4e7-1957-41f9-b7ba-0bf22b053ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651c21cefafc49f9911e8ed3e8a8251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:14Z,use_quota=True,user_id='7e1aaf87ebe34df7897b1cc5691ad922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783241c-2b8b-471a-9a41-73740e0be855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783241c-2b8b-471a-9a41-73740e0be855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9c78cc-faea-452b-bbdf-29b56e708af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9c78cc-faea-452b-bbdf-29b56e708af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3145d4e7-1957-41f9-b7ba-0bf22b053ec3', 'volume_name': 'volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d7e09d-6367-4f18-8a5d-a1221a8ed4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d7e09d-6367-4f18-8a5d-a1221a8ed4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4070116f-b426-4ce6-9d29-dca5494d7e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Volume 3145d4e7-1957-41f9-b7ba-0bf22b053ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3', 'volume_size': 1} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-198864831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3145d4e7-1957-41f9-b7ba-0bf22b053ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651c21cefafc49f9911e8ed3e8a8251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:14Z,use_quota=True,user_id='7e1aaf87ebe34df7897b1cc5691ad922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Creating volume 3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:13 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:13 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 1073741824 Sep 02 16:37:13 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (c12e5a18-1ff6-4a68-a724-b518c2768c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947fe79f-9b09-46f9-970b-37b2324434ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947fe79f-9b09-46f9-970b-37b2324434ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888400645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28235941-5caf-4c5d-ace1-1d2d210c6cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:14Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294964b7-ce8d-45fd-a62a-e6d7781918ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294964b7-ce8d-45fd-a62a-e6d7781918ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6962a734-137d-4b52-b418-ed5c7c0541df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6962a734-137d-4b52-b418-ed5c7c0541df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28235941-5caf-4c5d-ace1-1d2d210c6cdb', 'volume_name': 'volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:13 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565663a0-d634-4c90-9c36-2ca3fbbf099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565663a0-d634-4c90-9c36-2ca3fbbf099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdb37f3-8b50-4681-9e5c-22d3de15bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Volume 28235941-5caf-4c5d-ace1-1d2d210c6cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb', 'volume_size': 1} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:14 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 1073741824" returned: 0 in 0.426s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:14 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:14 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:14 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.243s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888400645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28235941-5caf-4c5d-ace1-1d2d210c6cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:14Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Creating volume 28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:14 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4070116f-b426-4ce6-9d29-dca5494d7e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:14 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb 1073741824 Sep 02 16:37:14 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1479de43-72d5-4cea-93cb-e21bb5cc57b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:14 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Volume volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 (3145d4e7-1957-41f9-b7ba-0bf22b053ec3): created successfully Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1479de43-72d5-4cea-93cb-e21bb5cc57b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Flow 'volume_create_manager' (0f3fa45c-1f60-48cd-bc9a-5d8353815026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:14 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b5de4623-edec-45cb-8aa0-c23d46f4a9c7 tempest-SnapshotDependencyTests-1410257068 None] Created volume successfully. Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:14 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb 1073741824" returned: 0 in 0.483s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:14 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:14 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb Sep 02 16:37:14 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:15 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.299s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Creating offline snapshot 874a6a02-f887-4623-8905-44659e6510db of volume 3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdb37f3-8b50-4681-9e5c-22d3de15bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad14fc69-fddc-4254-b070-3da62a791b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb70d5e0-0478-4a97-babf-dea416dc4c34]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:15 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Volume volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb (28235941-5caf-4c5d-ace1-1d2d210c6cdb): created successfully Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad14fc69-fddc-4254-b070-3da62a791b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (c12e5a18-1ff6-4a68-a724-b518c2768c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:15 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bf227c11-ccae-4d07-9d9f-772b78b0fc56 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:37:15 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:15 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:15 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.354s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:15 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:15 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db 1G Sep 02 16:37:15 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:15 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db 1G" returned: 0 in 0.398s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:16 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:16 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:16 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.292s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:16 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db is being set with open permissions: ugo+rw Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:16 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:16 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:16 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:16 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info Sep 02 16:37:16 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:16 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info" returned: 0 in 0.259s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:16 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info is being set with open permissions: ugo+rw Sep 02 16:37:16 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:16 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info Sep 02 16:37:16 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:17 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.info" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.908s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot 99d5fb55-e9be-451e-9a93-8238577ccc21 of volume 28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:17 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-7e613ebb-e6ab-4e76-a14d-40ee63b41b78 tempest-SnapshotDependencyTests-1410257068 None] Create snapshot completed successfully Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[972672c8-478d-4a9c-9e34-bd1ddbe7f4f4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:17 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb Sep 02 16:37:17 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:17 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:17 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 1G Sep 02 16:37:17 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:17 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 1G" returned: 0 in 0.371s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:17 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:17 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 Sep 02 16:37:17 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:18 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21" returned: 0 in 0.314s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:18 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 is being set with open permissions: ugo+rw Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:18 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 Sep 02 16:37:18 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:18 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21" returned: 0 in 0.280s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:18 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info Sep 02 16:37:18 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Flow 'volume_create_manager' (c7156e2e-2489-4bc2-a842-d7f17093c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abccfea2-0b6c-4da7-b09d-6ef13e748e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abccfea2-0b6c-4da7-b09d-6ef13e748e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a396b203-9926-4196-85e2-6120a039a3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651c21cefafc49f9911e8ed3e8a8251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=874a6a02-f887-4623-8905-44659e6510db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:19Z,use_quota=True,user_id='7e1aaf87ebe34df7897b1cc5691ad922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1873d6b-f776-4445-9e6e-1816df17e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1873d6b-f776-4445-9e6e-1816df17e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c63017-2249-48ae-b830-3e1cfe715268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c63017-2249-48ae-b830-3e1cfe715268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a396b203-9926-4196-85e2-6120a039a3e6', 'volume_name': 'volume-a396b203-9926-4196-85e2-6120a039a3e6', 'volume_size': 1, 'snapshot_id': '874a6a02-f887-4623-8905-44659e6510db'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd952238-ee76-477a-a6df-ca0a4f7e2035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd952238-ee76-477a-a6df-ca0a4f7e2035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56caa9f-8f1d-4de6-9afd-5a5141fd77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:18 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Volume a396b203-9926-4196-85e2-6120a039a3e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a396b203-9926-4196-85e2-6120a039a3e6', 'volume_size': 1, 'snapshot_id': '874a6a02-f887-4623-8905-44659e6510db'} Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:18 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:18 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info is being set with open permissions: ugo+rw Sep 02 16:37:18 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:18 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info Sep 02 16:37:18 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:19 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.info" returned: 0 in 0.243s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.329s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db-a396b203-9926-4196-85e2-6120a039a3e6" by "_create_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db-a396b203-9926-4196-85e2-6120a039a3e6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Creating volume a396b203-9926-4196-85e2-6120a039a3e6 from snapshot 874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" by "_copy_volume_from_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] snapshot: 874a6a02-f887-4623-8905-44659e6510db, volume: a396b203-9926-4196-85e2-6120a039a3e6, {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 16:37:19 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-484873a9-5084-43da-809a-67e3d4ac0a15 tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff2cdc-0b10-4bb4-8b41-abfd34e89dfe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:19 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:19 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-99d5fb55-e9be-451e-9a93-8238577ccc21-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-99d5fb55-e9be-451e-9a93-8238577ccc21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-99d5fb55-e9be-451e-9a93-8238577ccc21" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-99d5fb55-e9be-451e-9a93-8238577ccc21" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot 99d5fb55-e9be-451e-9a93-8238577ccc21 of volume 28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf19d77-77c9-49e8-9b5e-5231c242471a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:19 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 Sep 02 16:37:19 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:19 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.382s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa07678-cfe4-4d3a-9c71-8987690397f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:19 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:19 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:19 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21" returned: 0 in 0.376s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a9a27-3a69-4ed7-a170-3bbf07015bd7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:19 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:19 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb Sep 02 16:37:19 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.363s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Creating direct copy from snapshot {{(pid=87051) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG cinder.utils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Path /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 not found in is_blk_device check {{(pid=87051) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 16:37:19 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:19 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 Sep 02 16:37:19 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:20 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb" returned: 0 in 0.370s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:20 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 Sep 02 16:37:20 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:20 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21" returned: 0 in 0.698s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:20 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:20 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21 Sep 02 16:37:20 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:21 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:21 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb.99d5fb55-e9be-451e-9a93-8238577ccc21" returned: 0 in 0.500s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-99d5fb55-e9be-451e-9a93-8238577ccc21" released by "_delete_snapshot" :: held 2.055s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" released by "delete_snapshot" :: held 2.088s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:21 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Created reservations ['e36b9de1-3e80-4a54-a989-8414dd2bc550', '19f26bcf-6e01-4bee-a6a7-bfbb424fb41f', 'b788aaba-e4a6-47f6-9a7f-3b5285c73dc1', 'fa02af4a-aa3e-43bb-88ce-2e4994745840'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:21 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:21 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-09af516e-c31e-4a1e-b118-73dfaf7ad6aa tempest-ProjectMemberTests-1462193155 None] Lock "cinder-99d5fb55-e9be-451e-9a93-8238577ccc21-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-28235941-5caf-4c5d-ace1-1d2d210c6cdb-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-28235941-5caf-4c5d-ace1-1d2d210c6cdb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" acquired by "delete_volume" :: waited 0.026s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df824087-d536-4bca-98d4-73586399b640]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:22 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:23 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb Sep 02 16:37:23 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:23 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb" returned: 0 in 0.567s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:23 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:23 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb Sep 02 16:37:23 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:24 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-28235941-5caf-4c5d-ace1-1d2d210c6cdb" returned: 0 in 0.455s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-28235941-5caf-4c5d-ace1-1d2d210c6cdb" released by "delete_volume" :: held 1.177s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Created reservations ['21ae8430-d9b1-4ccd-ad2d-25fb0410c653', 'bff567e0-06b6-4a9e-8d9a-113996737977', '7b1349e1-f34d-4c64-874b-bdeaa1fdc585', '038cb9f3-9aba-4d8b-8afe-80418de18fc9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:24 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:24 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:24 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6" returned: 0 in 4.673s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.image.image_utils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Image conversion details: src /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 {{(pid=87051) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 16:37:24 devstack cinder-volume[87051]: INFO cinder.image.image_utils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Converted 1024.00 MB image at 219.05 MB/s Sep 02 16:37:24 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 is being set with open permissions: ugo+rw Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:24 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 Sep 02 16:37:24 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:24 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:24 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-df3eb203-d00e-405f-96ad-a1db8ee82595 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-28235941-5caf-4c5d-ace1-1d2d210c6cdb-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:24 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6" returned: 0 in 0.264s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" released by "_copy_volume_from_snapshot" :: held 5.777s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db-a396b203-9926-4196-85e2-6120a039a3e6" released by "_create_volume_from_snapshot" :: held 5.837s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.861s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56caa9f-8f1d-4de6-9afd-5a5141fd77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a396b203-9926-4196-85e2-6120a039a3e6', 'volume_size': 1, 'snapshot_id': '874a6a02-f887-4623-8905-44659e6510db'}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2c157a-5f87-4bd4-a308-d97d53ec47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:24 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Volume volume-a396b203-9926-4196-85e2-6120a039a3e6 (a396b203-9926-4196-85e2-6120a039a3e6): created successfully Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2c157a-5f87-4bd4-a308-d97d53ec47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:24 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Flow 'volume_create_manager' (c7156e2e-2489-4bc2-a842-d7f17093c29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:25 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-428ec7a2-bbc7-421b-bb4d-1c053e357ffb tempest-SnapshotDependencyTests-1410257068 None] Created volume successfully. Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-874a6a02-f887-4623-8905-44659e6510db-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-874a6a02-f887-4623-8905-44659e6510db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Deleting offline snapshot 874a6a02-f887-4623-8905-44659e6510db of volume 3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] snapshot_file for this snap is: volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98089c-526a-46f7-9039-bd626065c77c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:25 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:25 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (a0dde982-df56-475a-ae88-16418c0ef58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b22bae7-588f-4c4f-802e-3282e9371a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b22bae7-588f-4c4f-802e-3282e9371a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382011872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937bba12-5290-4496-92f8-a0f8cb37008e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:26Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cebce1-2261-4992-b948-a2fb67e86dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cebce1-2261-4992-b948-a2fb67e86dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092953c3-74d7-4dc3-86c6-78dd911bbd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092953c3-74d7-4dc3-86c6-78dd911bbd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937bba12-5290-4496-92f8-a0f8cb37008e', 'volume_name': 'volume-937bba12-5290-4496-92f8-a0f8cb37008e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7acee69-7c07-4ef1-812b-836fa532c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7acee69-7c07-4ef1-812b-836fa532c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bfbd60-d481-43a0-a8e4-ed91a68eb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:25 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Volume 937bba12-5290-4496-92f8-a0f8cb37008e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937bba12-5290-4496-92f8-a0f8cb37008e', 'volume_size': 1} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382011872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937bba12-5290-4496-92f8-a0f8cb37008e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:26Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Creating volume 937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:25 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:25 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e 1073741824 Sep 02 16:37:25 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:25 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.388s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a88fe8-10d2-456a-8e24-3b787edfeffe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:25 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:25 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:25 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:26 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e 1073741824" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:26 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e Sep 02 16:37:26 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:26 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.588s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:26 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e" returned: 0 in 0.263s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:26 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:26 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bfbd60-d481-43a0-a8e4-ed91a68eb15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937bba12-5290-4496-92f8-a0f8cb37008e', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fb53a-5143-4f12-8aa7-78f37b402f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:26 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Volume volume-937bba12-5290-4496-92f8-a0f8cb37008e (937bba12-5290-4496-92f8-a0f8cb37008e): created successfully Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fb53a-5143-4f12-8aa7-78f37b402f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (a0dde982-df56-475a-ae88-16418c0ef58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:26 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-bd0bcdfc-2fee-4dac-a12d-20fd91d89478 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:26 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot ed509cee-9c34-48fa-8f1c-800066acf6c8 of volume 937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.394s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb51ab7-7f75-4bc0-9e35-94073470e6da]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:26 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:26 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db Sep 02 16:37:26 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:26 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e Sep 02 16:37:26 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:27 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3.874a6a02-f887-4623-8905-44659e6510db" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-874a6a02-f887-4623-8905-44659e6510db" released by "_delete_snapshot" :: held 1.726s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" released by "delete_snapshot" :: held 1.755s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Created reservations ['b68b4317-024d-410a-8b16-80b91d14dc9c', '93b67549-af69-489e-ac00-abb8282e178c', 'd4c6d1b3-ddbd-4f61-bb39-4ef0d7cd10d5', '0d753995-f921-41c0-944f-778f1d6531c1'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:27 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e" returned: 0 in 0.390s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:27 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Delete snapshot completed successfully. Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-b9e8dd59-4ebe-4a16-b85c-e351bf40809c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-874a6a02-f887-4623-8905-44659e6510db-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:27 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 1G Sep 02 16:37:27 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-3145d4e7-1957-41f9-b7ba-0bf22b053ec3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-3145d4e7-1957-41f9-b7ba-0bf22b053ec3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0c11d-c46a-4f54-b316-1b26938a6383]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:27 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 1G" returned: 0 in 0.418s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937bba12-5290-4496-92f8-a0f8cb37008e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:27 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937bba12-5290-4496-92f8-a0f8cb37008e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 Sep 02 16:37:27 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:27 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:27 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:27 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937bba12-5290-4496-92f8-a0f8cb37008e -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8" returned: 0 in 0.300s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:27 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 is being set with open permissions: ugo+rw Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:27 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 Sep 02 16:37:27 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:27 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.388s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:27 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:28 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3 Sep 02 16:37:28 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:28 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8" returned: 0 in 0.244s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:28 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info Sep 02 16:37:28 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:28 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" returned: 0 in 0.252s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-3145d4e7-1957-41f9-b7ba-0bf22b053ec3" released by "delete_volume" :: held 0.698s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Created reservations ['74fce60b-947f-4ab4-800a-098fc711cf2b', '34e54394-8449-466d-9f89-0ddf7ecb268a', 'b7a9adfa-256e-4cf2-af13-cac150771df4', '40c9fb5a-004d-4815-bdeb-a7bde801ff02'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:28 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:28 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:28 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info" returned: 0 in 0.260s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:28 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info is being set with open permissions: ugo+rw Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:28 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info Sep 02 16:37:28 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:28 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.271s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-a396b203-9926-4196-85e2-6120a039a3e6-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Deleted volume successfully. Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-a396b203-9926-4196-85e2-6120a039a3e6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-db072c32-ab8f-422b-b161-f2a273dad66c tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-3145d4e7-1957-41f9-b7ba-0bf22b053ec3-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" acquired by "delete_volume" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:28 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.info" returned: 0 in 0.326s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272e4cb-9496-4b54-bef0-3b458e1bb6c6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:28 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:28 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d22c26cc-e4ec-4153-b4b3-c28cac036e3a tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:28 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 Sep 02 16:37:28 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:29 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6" returned: 0 in 0.367s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:29 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6 Sep 02 16:37:29 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:29 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-a396b203-9926-4196-85e2-6120a039a3e6" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-quobyte-a396b203-9926-4196-85e2-6120a039a3e6" released by "delete_volume" :: held 0.679s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Created reservations ['b3a8fc59-6ee9-41d4-8022-fe8f2a48f2c2', '166ed92d-f468-4fca-a593-d89d26bd875b', '5e57c0ea-bb5c-4f0d-86c4-0cd2a4b7a0ab', '56cb9f6f-ba56-46df-8af4-68eb5ad09d41'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:29 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:29 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:29 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.243s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:29 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Deleted volume successfully. Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-3b2c3ba1-1632-400a-ab5e-a62b6257a9af tempest-SnapshotDependencyTests-1410257068 None] Lock "cinder-a396b203-9926-4196-85e2-6120a039a3e6-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-ed509cee-9c34-48fa-8f1c-800066acf6c8-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-ed509cee-9c34-48fa-8f1c-800066acf6c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:29 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-ed509cee-9c34-48fa-8f1c-800066acf6c8" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed509cee-9c34-48fa-8f1c-800066acf6c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot ed509cee-9c34-48fa-8f1c-800066acf6c8 of volume 937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f6e49-5b92-4d50-aa86-acab66c11176]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:30 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 Sep 02 16:37:30 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:30 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8" returned: 0 in 0.377s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937bba12-5290-4496-92f8-a0f8cb37008e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1a2fd-37c7-4487-b1f8-02d9dfebb33a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:30 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e Sep 02 16:37:30 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:30 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e" returned: 0 in 0.419s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:30 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:30 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 Sep 02 16:37:30 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:31 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8" returned: 0 in 0.355s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:31 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8 Sep 02 16:37:31 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:31 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e.ed509cee-9c34-48fa-8f1c-800066acf6c8" returned: 0 in 0.282s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-ed509cee-9c34-48fa-8f1c-800066acf6c8" released by "_delete_snapshot" :: held 1.532s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" released by "delete_snapshot" :: held 1.556s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Created reservations ['8fd8bbc3-19e4-4044-a20a-0679a19960ee', '2872b33e-266d-4fbf-b788-af4af1d8d159', '3d52dea5-9d90-4aed-b62c-2bba56d22b2b', 'f4f1b89a-471f-4af5-994d-8d73b579e5d5'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:31 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:31 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-cf0d9f4a-d917-485e-a31e-d9acebb8ded3 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-ed509cee-9c34-48fa-8f1c-800066acf6c8-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-937bba12-5290-4496-92f8-a0f8cb37008e-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-937bba12-5290-4496-92f8-a0f8cb37008e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" acquired by "delete_volume" :: waited 0.015s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e9ab3-5258-4d3c-9354-ede23d5e0d85]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:32 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e Sep 02 16:37:32 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:32 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e" returned: 0 in 0.368s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:32 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e Sep 02 16:37:32 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:32 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-937bba12-5290-4496-92f8-a0f8cb37008e" returned: 0 in 0.247s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-937bba12-5290-4496-92f8-a0f8cb37008e" released by "delete_volume" :: held 0.705s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:32 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Created reservations ['502b8a7b-1013-4115-b574-8372e8a9cef5', '0484016a-397f-435f-8284-42c56265f3fd', 'cd309092-95fb-4f5b-9345-a61c06b66fdc', 'e4ad4099-70e3-49ef-823d-7a4df1a37a60'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:33 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:33 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:33 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.258s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:33 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-5fb43e17-076b-477d-a791-03e45e26879b tempest-ProjectMemberTests-1462193155 None] Lock "cinder-937bba12-5290-4496-92f8-a0f8cb37008e-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (3fc31175-d133-4275-9b9a-d2bbc7ce36f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefccd2-5595-4677-8a41-17f71904161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aefccd2-5595-4677-8a41-17f71904161e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116744487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292a7bb5-f2e9-47de-beb6-f778112fb1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:34Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b2169-9429-4bbf-b88a-3d63ab559a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b2169-9429-4bbf-b88a-3d63ab559a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b576aa75-ad1e-4da1-95fa-b22e6e607a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b576aa75-ad1e-4da1-95fa-b22e6e607a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292a7bb5-f2e9-47de-beb6-f778112fb1e3', 'volume_name': 'volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3da1f9-5155-4ff3-8a62-c0d5f6a78b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3da1f9-5155-4ff3-8a62-c0d5f6a78b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ce5fbb-b5ca-4bf4-8875-012fa46e34a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:33 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Volume 292a7bb5-f2e9-47de-beb6-f778112fb1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3', 'volume_size': 1} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116744487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292a7bb5-f2e9-47de-beb6-f778112fb1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:34Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Creating volume 292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:33 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:33 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:33 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 1073741824 Sep 02 16:37:33 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:34 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 1073741824" returned: 0 in 0.505s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:34 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 Sep 02 16:37:34 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:34 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3" returned: 0 in 0.289s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ce5fbb-b5ca-4bf4-8875-012fa46e34a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a67c9-0321-4921-a8f0-373e34fe40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:34 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Volume volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 (292a7bb5-f2e9-47de-beb6-f778112fb1e3): created successfully Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a67c9-0321-4921-a8f0-373e34fe40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:34 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (3fc31175-d133-4275-9b9a-d2bbc7ce36f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:34 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-0cc9382f-9dc6-4385-89da-11e2ef227f45 tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot 85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 of volume 292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea433b-a8cf-4008-92bd-f23ec5d6fd3a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:36 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 Sep 02 16:37:36 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:36 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3" returned: 0 in 0.364s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:36 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 1G Sep 02 16:37:36 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:36 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 1G" returned: 0 in 0.380s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:36 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:36 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 Sep 02 16:37:36 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:37 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" returned: 0 in 0.343s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:37 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 is being set with open permissions: ugo+rw Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:37 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 Sep 02 16:37:37 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:37 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" returned: 0 in 0.262s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:37 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info Sep 02 16:37:37 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:37 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info" returned: 0 in 0.266s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:37 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info is being set with open permissions: ugo+rw Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:37 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info Sep 02 16:37:37 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:37 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:37 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.info" returned: 0 in 0.270s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:38 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-f4134e0f-a8db-4977-8349-7b843a4f327f tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot 85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 of volume 292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e10bbc-79f6-4984-a101-9d2653d903e8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:38 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 Sep 02 16:37:38 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:38 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" returned: 0 in 0.356s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7658db-38c2-498a-9362-d12ab92f26f8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:38 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:38 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 Sep 02 16:37:38 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:39 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3" returned: 0 in 0.399s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:39 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 Sep 02 16:37:39 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:39 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" returned: 0 in 0.348s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:39 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1 Sep 02 16:37:39 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:39 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3.85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" returned: 0 in 0.272s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1" released by "_delete_snapshot" :: held 1.486s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" released by "delete_snapshot" :: held 1.513s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Created reservations ['2929aa1c-2503-4299-a42b-b7e2ae966272', 'ea6b5583-7dd7-4f80-8c86-0069fb2b819c', 'b7b2998f-b849-4605-89df-15f02a99cc83', '13136751-830f-483e-9a58-52ee6b7f2a55'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:39 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:39 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-e569b92c-afd6-408a-8e3d-19fd85a7f95a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-85b2b40a-5ed7-4ce6-b16e-5b0d2fc9b0a1-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-292a7bb5-f2e9-47de-beb6-f778112fb1e3-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-292a7bb5-f2e9-47de-beb6-f778112fb1e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" acquired by "delete_volume" :: waited 0.014s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bca5cf-23ec-4ab5-9b0c-d47b8b27ff7c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:40 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 Sep 02 16:37:40 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:40 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3" returned: 0 in 0.397s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:40 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:40 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3 Sep 02 16:37:40 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:41 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-292a7bb5-f2e9-47de-beb6-f778112fb1e3" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-292a7bb5-f2e9-47de-beb6-f778112fb1e3" released by "delete_volume" :: held 0.730s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Created reservations ['fa31b0d6-9d1e-49f5-8e70-f3e2a47fe1d3', 'f158db1f-f36f-426f-8b13-014be7eba3fd', 'ee265cb9-8506-4a02-b5a9-9977f3c94912', 'be34f899-e331-4990-85c3-1bf346368be9'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:41 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:41 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:41 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.261s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:41 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-4169f35f-a015-461e-8a2c-602ca5d04e08 tempest-ProjectMemberTests-1462193155 None] Lock "cinder-292a7bb5-f2e9-47de-beb6-f778112fb1e3-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:41 devstack cinder-volume[87051]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87051) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (4718bc38-e619-440a-a395-5ea9b3cd816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c173f001-fe76-47c6-ada6-0a09de0fd464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c173f001-fe76-47c6-ada6-0a09de0fd464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488712354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:42Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bda583-3ba2-4715-9d43-4657f0d1566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bda583-3ba2-4715-9d43-4657f0d1566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd77553d-ef0e-44a6-90ca-6a50bf1354d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd77553d-ef0e-44a6-90ca-6a50bf1354d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6bedda3-6cf2-4a6a-bd0b-f81953bca7c4', 'volume_name': 'volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee88d51-72bb-4550-8028-577930c2a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee88d51-72bb-4550-8028-577930c2a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe426e-12f5-485e-9a40-8bdd6e2825aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Volume d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4', 'volume_size': 1} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488712354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148c77f7f5e4493a9f4a2ad7aba69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T14:37:42Z,use_quota=True,user_id='a695c18bc9f74e8eaa899d36047ca804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(791a8dad-6ab1-4d18-a97f-6f4a74ce935c),volume_type_id=791a8dad-6ab1-4d18-a97f-6f4a74ce935c)}" {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Creating volume d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Selected osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd as target Quobyte volume. {{(pid=87051) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 16:37:42 devstack cinder-volume[87051]: INFO cinder.volume.drivers.remotefs [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] casted to osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 1073741824 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:42 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 1073741824 Sep 02 16:37:42 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:42 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 1073741824" returned: 0 in 0.410s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:42 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 Sep 02 16:37:42 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:42 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" returned: 0 in 0.253s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'} {{(pid=87051) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe426e-12f5-485e-9a40-8bdd6e2825aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4', 'volume_size': 1}' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275a166-6239-4bbf-8d3e-cd384d8b5a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 16:37:42 devstack cinder-volume[87051]: INFO cinder.volume.flows.manager.create_volume [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Volume volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 (d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4): created successfully Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275a166-6239-4bbf-8d3e-cd384d8b5a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87051) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 16:37:42 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Flow 'volume_create_manager' (4718bc38-e619-440a-a395-5ea9b3cd816d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87051) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 16:37:42 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d0dd9c1e-929a-4e6c-affc-8d2cb8a29e7c tempest-ProjectMemberTests-1462193155 None] Created volume successfully. Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Creating offline snapshot 0c79ed4a-c71c-4598-b101-3aa95c1d0e48 of volume d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022f5d0-7512-4115-9847-335a08ab1104]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:43 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 Sep 02 16:37:43 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:43 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" returned: 0 in 0.352s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 1G {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:43 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 1G Sep 02 16:37:43 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:43 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 1G" returned: 0 in 0.389s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:43 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:43 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 Sep 02 16:37:43 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:44 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 -F qcow2 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48" returned: 0 in 0.301s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:44 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 is being set with open permissions: ugo+rw Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:44 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 Sep 02 16:37:44 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:44 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48" returned: 0 in 0.246s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:44 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info Sep 02 16:37:44 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:44 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info" returned: 0 in 0.250s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:44 devstack cinder-volume[87051]: WARNING cinder.volume.drivers.remotefs [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info is being set with open permissions: ugo+rw Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:44 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info Sep 02 16:37:44 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:44 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:44 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.info" returned: 0 in 0.241s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:45 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-2c5e2504-5df5-45e3-acd6-44637f848ae0 tempest-ProjectMemberTests-1462193155 None] Create snapshot completed successfully Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-0c79ed4a-c71c-4598-b101-3aa95c1d0e48-delete_snapshot" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-0c79ed4a-c71c-4598-b101-3aa95c1d0e48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" by "delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-0c79ed4a-c71c-4598-b101-3aa95c1d0e48" by "_delete_snapshot" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-0c79ed4a-c71c-4598-b101-3aa95c1d0e48" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Deleting offline snapshot 0c79ed4a-c71c-4598-b101-3aa95c1d0e48 of volume d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] snapshot_file for this snap is: volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062391b-afaf-40e2-a74f-7d6cc448edf5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:45 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 Sep 02 16:37:45 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:45 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48" returned: 0 in 0.360s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.remotefs [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87051) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b4595a-188c-4428-940d-8ee78f83747f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:45 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:45 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 Sep 02 16:37:45 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:46 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" returned: 0 in 0.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:46 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 Sep 02 16:37:46 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:46 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48" returned: 0 in 0.320s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:46 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48 Sep 02 16:37:46 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:46 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4.0c79ed4a-c71c-4598-b101-3aa95c1d0e48" returned: 0 in 0.246s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-0c79ed4a-c71c-4598-b101-3aa95c1d0e48" released by "_delete_snapshot" :: held 1.378s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" released by "delete_snapshot" :: held 1.398s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Created reservations ['9ee16bbd-a829-44fc-a2d8-5707c59304b4', '0a7b93a4-264b-46da-81b7-ff8f865ea45c', 'e6012250-81d7-4f93-ab92-088d809814c5', '499884a6-e17b-42c4-9bb8-976a65924db7'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:46 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Delete snapshot completed successfully. Sep 02 16:37:46 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-8409fde0-e136-4ad6-82d4-206d6fb0e52a tempest-ProjectMemberTests-1462193155 None] Lock "cinder-0c79ed4a-c71c-4598-b101-3aa95c1d0e48-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4-delete_volume" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" by "delete_volume" {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87051) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0ea4e-1b73-498c-97e0-ddda310c7afd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:47 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 Sep 02 16:37:47 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:47 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" returned: 0 in 0.358s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:47 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:48 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4 Sep 02 16:37:48 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:48 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca/volume-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" returned: 0 in 0.249s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-quobyte-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4" released by "delete_volume" :: held 0.664s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.quota [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Created reservations ['1e0b64eb-53c9-4c91-847f-ccf2ba8ad9f2', '156b3f0f-01fd-4a47-89f4-43d7c0241590', 'f7cd4a7e-4643-470a-99e6-372bf4f19e93', '72c34fda-3d60-4fe4-a332-af6e18534454'] {{(pid=87051) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:48 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:48 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:48 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.252s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:48 devstack cinder-volume[87051]: INFO cinder.volume.manager [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Deleted volume successfully. Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.coordination [None req-d6cb2681-2d91-48fd-9488-f74edf85430c tempest-ProjectMemberTests-1462193155 None] Lock "cinder-d6bedda3-6cf2-4a6a-bd0b-f81953bca7c4-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87051) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd': None} {{(pid=87051) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd47e891-285c-4803-93c2-be159bd2d9fd'] {{(pid=87051) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.lockutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87051) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 16:37:48 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca Sep 02 16:37:48 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 16:37:48 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_concurrency.processutils [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df564eefa9cb392868ebf49472526dca" returned: 0 in 0.256s {{(pid=87051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Notifying Schedulers of capabilities ... {{(pid=87051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG oslo_service.periodic_task [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] Running periodic task VolumeManager._thread_info {{(pid=87051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread count: 28 {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 16:37:48 devstack cinder-volume[87051]: DEBUG cinder.volume.manager [None req-1ae40c21-6faf-4382-84d5-d04c3bd0d0df None None] thread info: [<_MainThread(MainThread, started 131038492926080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87051) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 16:37:58 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:DELETE=10,cinder:SELECT=99,cinder:INSERT=36,cinder:UPDATE=108 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 16:37:58 devstack cinder-volume[87051]: DEBUG dbcounter [-] [87051] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=87051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}